-- Logs begin at Thu 2022-08-18 23:55:55 UTC, end at Fri 2022-08-19 01:19:46 UTC. -- Aug 19 00:52:06.619807 dv-osbrick-853710-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 00:52:06.629039 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 00:52:06 2022] *** Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: nodename: dv-osbrick-853710-1-ceph Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: machine: x86_64 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: clock source: unix Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: pcre jit disabled Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: detected number of CPU cores: 4 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: current working directory: / Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: detected binary path: /usr/bin/uwsgi-core Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: your processes number limit is 47680 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: your memory page size is 4096 bytes Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: detected max file descriptor number: 2048 Aug 19 00:52:06.631020 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: lock engine: pthread robust mutexes Aug 19 00:52:06.631759 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: thunder lock: enabled Aug 19 00:52:06.631759 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 00:52:06.631759 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 00:52:06.674206 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: Python main interpreter initialized at 0x55fc838fe9c0 Aug 19 00:52:06.674206 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: python threads support enabled Aug 19 00:52:06.674206 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: your server socket listen backlog is limited to 100 connections Aug 19 00:52:06.674206 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: your mercy for graceful operations on workers is 90 seconds Aug 19 00:52:06.674575 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 00:52:06.674575 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: *** Operational MODE: preforking *** Aug 19 00:52:06.674855 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: *** uWSGI is running in multiple interpreter mode *** Aug 19 00:52:06.674855 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: spawned uWSGI master process (pid: 88427) Aug 19 00:52:06.675067 dv-osbrick-853710-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 00:52:06.676677 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: spawned uWSGI worker 1 (pid: 88438, cores: 1) Aug 19 00:52:06.676677 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: spawned uWSGI worker 2 (pid: 88439, cores: 1) Aug 19 00:52:06.676677 dv-osbrick-853710-1-ceph devstack@keystone.service[88427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 00:52:11.257554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 00:52:11.257554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: from cryptography.utils import int_from_bytes Aug 19 00:52:11.258349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 00:52:11.258349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: from cryptography.utils import int_from_bytes Aug 19 00:52:11.258709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 00:52:11.258709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: from cryptography.utils import int_from_bytes Aug 19 00:52:11.259242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 00:52:11.259242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: from cryptography.utils import int_from_bytes Aug 19 00:52:11.308384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 00:52:11.308596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 00:52:11.308683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 00:52:11.308773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] command line args: [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 00:52:11.308856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 00:52:11.308969 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] command line args: [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 00:52:11.309048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 00:52:11.309203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ================================================================================ {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 00:52:11.309338 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 00:52:11.309429 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ================================================================================ {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 00:52:11.309493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] admin_token = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.309689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] admin_token = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.309821 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] config_dir = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.309821 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.309968 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] config_dir = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310032 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] config_source = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] debug = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310226 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] config_source = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] debug = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310917 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.310978 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311143 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311224 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_config_append = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311837 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_config_append = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.311969 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312091 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_dir = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_dir = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_file = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_file = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.312983 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313064 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.313977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314247 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314778 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.314928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315191 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315525 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.315889 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316518 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] publish_errors = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] publish_errors = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.316971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317090 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317176 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317256 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317328 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317775 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.317857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] standard_threads = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] standard_threads = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318466 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318603 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318820 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] use_journal = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318894 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] use_journal = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.318962 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] use_json = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319085 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] use_json = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319168 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] use_stderr = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319243 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] use_stderr = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] use_syslog = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] use_syslog = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 00:52:11.319717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.319811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.319951 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320411 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.320838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321015 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.321958 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322290 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322437 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.322916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323001 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.323946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324361 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324594 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.324939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325114 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.325917 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326603 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.326847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327308 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327458 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.327939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328021 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328170 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328412 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.328874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329582 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329806 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.329877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330490 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.330947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331630 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331714 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.331940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332092 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332561 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.332872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333057 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.333957 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334192 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334276 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334493 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334736 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.334958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.335874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.336871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337755 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.337986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338314 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338457 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.338919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339790 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.339876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340175 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340313 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340538 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.340813 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.341914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342031 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342294 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342808 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.342893 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343351 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.343988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.external = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.344983 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.password = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345293 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] auth.token = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.external = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345758 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.345910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346263 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.password = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] auth.token = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.346988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.347950 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348515 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.348915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349184 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349434 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349520 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349920 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.349999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.350938 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351601 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351682 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.351854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352010 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352122 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.352930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353173 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353330 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.353902 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354295 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354621 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354776 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.354856 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355498 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355584 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355730 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.355958 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356190 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356513 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.356937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.357883 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.358993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.359925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360617 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.360947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361346 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361817 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.361895 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362369 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362746 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.362979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363283 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363518 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363901 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.363979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364684 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.364997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365156 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365555 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365798 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.365878 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366262 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366568 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.366995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367082 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.367939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368018 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368178 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368255 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368636 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.368867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369117 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369209 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369813 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.369904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370047 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370283 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.370974 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371449 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371531 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.371999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372381 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.372981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373334 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373808 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.373887 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374040 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374352 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374588 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374746 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374832 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.374975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375210 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375449 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375693 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375772 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.375939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376259 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376416 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376495 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376741 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.376912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377599 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.377898 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] role.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378098 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] role.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.378897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] role.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] role.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.379925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380164 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380391 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380713 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.380876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381463 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381666 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.381921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382458 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382536 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.382848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.383855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384102 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384338 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384488 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384568 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.384970 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385300 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.385951 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386406 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386495 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386870 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.386948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387434 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.387937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388087 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388328 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388656 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388812 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.388905 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.389898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390008 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390421 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390680 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.390995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.connection = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391488 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391877 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.391955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.connection = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.392885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393288 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.393995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.394963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.395117 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.395197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.395269 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 00:52:11.395373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.395655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.395913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.396175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.396411 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.396674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.396930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 00:52:11.397106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 00:52:11.424037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.424304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.424522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.425580 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.425817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.426050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.433137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.435221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.462415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.462664 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.463916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.464153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.513712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.514901 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.561545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.561807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.563821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.564062 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.627413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.627591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.627833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.627958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628032 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.628750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.629001 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.651828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.652073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.652285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.652502 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.652718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.652945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.653039 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.653150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.653241 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.653635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.653998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.654390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.654781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.655023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.666743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.668049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.679301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.679638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.679882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680798 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.680883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.681119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.681336 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.681557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.681781 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.681965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 00:52:11.698130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.698313 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 00:52:11.698516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.698646 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.698720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 00:52:11.698837 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 00:52:11.699033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699262 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 00:52:11.699341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699620 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.699996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.700237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.709235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.709489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.709655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.709816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.709963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.710103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.710257 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.710397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.716931 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.718830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.719761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.720045 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.720356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.720652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.720936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.721221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.721490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.721735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.721854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.722801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.723081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.723335 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.723610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.723879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.724148 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.724410 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.746845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.747667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.748300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.748559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.749164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.749449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.753130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.753414 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.753805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.753933 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.754170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.756073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.760070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.760366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.762882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.763168 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.764312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.764558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.764840 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.765238 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.765517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.765794 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.766067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.766337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.767071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.767366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.767650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.768041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.768318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.768596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.768869 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.769163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.781604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.781880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.785067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.785342 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.785633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.788650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.789189 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.789652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.792710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.793144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.793379 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.796423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.797302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.799511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.799809 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.800087 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.800410 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.800502 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.800741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.801060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.803489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.803807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.804103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.804610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.805419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.805715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.817062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.817347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.817612 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.817881 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.822168 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.822519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.822715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.822973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.824601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.826285 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.826558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.829206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.829491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.829705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.829792 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.830043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.830316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.831258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.831533 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.834185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.834470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.834760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.835039 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.835328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.841440 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.841727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.842000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.842273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.842549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.842802 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.843075 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.846909 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.847174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.847453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.847746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.848009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.848305 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.848580 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.858363 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.861237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.864243 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.864368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.865692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.867204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.867485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.867739 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.867910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.870790 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.872223 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.873710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.874002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.874299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.874390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.875758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.878598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.878899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.879174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.879474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.880640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.882105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.885571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.885871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.886159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.886418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.888439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.888745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.889031 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.894284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.894574 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.894854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.895768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.896154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.896442 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.896726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.897027 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.897302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.897585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.897857 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.898155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.898508 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.898790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.899053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.899331 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.899567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.902024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 00:52:11.903245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.903549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.903832 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.904119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.904402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.904679 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.904950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.905260 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.905528 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.905810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.906078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.906332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.906593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 00:52:11.932230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc838fe9c0 pid: 88439 (default app) Aug 19 00:52:11.935637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8938-c962-4fa6-8007-b0ad21cfe9d4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:11.935927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8938-c962-4fa6-8007-b0ad21cfe9d4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:11.936199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf8938-c962-4fa6-8007-b0ad21cfe9d4 None None] PATH_INFO: `/v3` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:11.940246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc838fe9c0 pid: 88438 (default app) Aug 19 00:52:11.940715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Fri Aug 19 00:52:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:19.020640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:19.021559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:19.021559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:19.026528 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:19.032780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:19.033227 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:19.033408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:19.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: INFO dbcounter [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] Registered counter for database keystone Aug 19 00:52:19.140481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG oslo_db.sqlalchemy.engines [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 00:52:19.150942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writer thread running {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 00:52:19.356856 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG passlib.handlers.bcrypt [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88439) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 00:52:19.357205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG passlib.handlers.bcrypt [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88439) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 00:52:19.414475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:19.416072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:19.565011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 534 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 00:52:20.107197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:20.182839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: INFO dbcounter [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] Registered counter for database keystone Aug 19 00:52:20.208077 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG oslo_db.sqlalchemy.engines [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 00:52:20.220028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writer thread running {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 00:52:20.340498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adeb1f-b8f0-4f69-9c70-12d6b158e40f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:20.345908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:20.346523 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:20.346800 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:20.347058 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:20.356228 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:20.407142 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 00:52:20.407418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af5bb-c5c4-4f0c-ba8d-f61b5601caba admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:20.418084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1324 bytes} [Fri Aug 19 00:52:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 00:52:20.425165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:20.450912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33607a-fc3a-4c62-a970-6fbd8a629d1c None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:20.457431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:20.458558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:20.458842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:20.459112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] PATH_INFO: `/v3/projects/560e1cc0afb64bafa1e6557ba86b9432` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:20.460779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] RBAC: Authorizing `identity:get_project(project_id=560e1cc0afb64bafa1e6557ba86b9432)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:20.510658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 00:52:20.511000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56d395-7673-4c5e-a43e-0d64ac966e18 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:20.515610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 3/5] 10.222.0.78 () {56 vars in 1207 bytes} [Fri Aug 19 00:52:20 2022] GET /identity/v3/projects/560e1cc0afb64bafa1e6557ba86b9432 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:22.700152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c804ae5-950c-47f0-a15b-d40409d4468a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:22.701059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c804ae5-950c-47f0-a15b-d40409d4468a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:22.701059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c804ae5-950c-47f0-a15b-d40409d4468a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:22.707860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 3/6] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:22.713937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:22.714358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:22.714483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:22.735388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:22.736916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:22.745621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 00:52:23.078156 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c804ae5-950c-47f0-a15b-d40409d4468a None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:23.101429 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c804ae5-950c-47f0-a15b-d40409d4468a None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:23.106711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:23.107316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:23.107600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:23.107863 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:23.116244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:23.118095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f5dde-68b1-40d8-a8d6-7fc41d574090 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:23.127572 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1324 bytes} [Fri Aug 19 00:52:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 00:52:23.135664 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:23.149843 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0969f8-569a-49b7-a770-119a585b5d9a None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:23.158574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:23.159472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:23.159858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:23.160186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:23.162496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:23.164745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504348c-3eef-490f-86b2-d91115795c30 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:23.166369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 5/9] 10.222.0.78 () {56 vars in 1198 bytes} [Fri Aug 19 00:52:23 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:25.408252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374eb-fa2c-4d00-a4c5-0687c3145c49 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:25.408787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374eb-fa2c-4d00-a4c5-0687c3145c49 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:25.408787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374eb-fa2c-4d00-a4c5-0687c3145c49 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:25.410304 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:25.416054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:25.416500 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:25.416718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:25.420983 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90196-be1b-4688-9de3-ede2770a402e None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:25.421257 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90196-be1b-4688-9de3-ede2770a402e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:25.421531 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90196-be1b-4688-9de3-ede2770a402e None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:25.423002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 6/11] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:52:25.427768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549980-c50e-4387-a3c3-448285f8619f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:25.428049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549980-c50e-4387-a3c3-448285f8619f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:25.428335 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549980-c50e-4387-a3c3-448285f8619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:25.437372 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:25.438570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:25.469885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG passlib.handlers.bcrypt [None req-26549980-c50e-4387-a3c3-448285f8619f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 00:52:25.470283 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG passlib.handlers.bcrypt [None req-26549980-c50e-4387-a3c3-448285f8619f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 00:52:25.515737 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-26549980-c50e-4387-a3c3-448285f8619f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:25.517385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-26549980-c50e-4387-a3c3-448285f8619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:25.637536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 6/12] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:25.638243 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 7/13] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:52:25.955869 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:25.968911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549980-c50e-4387-a3c3-448285f8619f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:25.984459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.068712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc74db0-6273-4ca9-b4d4-bf45b44e5c66 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.070298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.073101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549980-c50e-4387-a3c3-448285f8619f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.107301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.107923 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.108179 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.108453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.111545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.112682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.112996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.113253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.125034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:26.133543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:26.134476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:26.135312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 8/14] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:52:26.140623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.179525 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.181013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.203340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.240398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97e2f-0d99-4bdf-9db7-19c178bf684d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.279212 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:26.279391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.279998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.280281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.280556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.281246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:26.281575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.283013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.284842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.295749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 9/16] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:26.301208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.325204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.385445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc927b-a506-4df9-94fc-652fba8ab981 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.399505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901adce-4bca-4682-8dd0-371019efc0e1 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.409511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.422538 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.423186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.423451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.423724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.435197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.435694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.435857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.436138 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.436409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.437321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.438235 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.439701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.441268 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 10/17] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:26.447159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:52:26.456029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:26.457169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:52:26.458165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:52:26.458165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:52:26.458165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:26.458165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 8/18] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:52:26.463245 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.573123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64e6a3-8bed-475b-a22c-5f1dcce5cfa4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.616207 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.616842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.617154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.617413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.618070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:26.618374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.619781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.638279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 9/19] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:26.650486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.662384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eebb7-8bd8-4727-a6d8-79e61e781c52 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.700349 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.701022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.701301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.701567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.702784 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.704245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650e596-fdf8-4683-a440-9f5cb1863ce4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.705897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 11/20] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:26.712497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:26.750286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:26.820611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2310c82-a1d3-4345-a87b-493a2516cbc3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:26.856818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:26.857410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:26.857686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:26.857955 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:26.858673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.domain.id=default, user.id=9fd2a745f79241bebdcc3d551a59c8f5) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:26.858976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:26.860424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e258-d12b-426b-b916-2fe0b3b8cb2b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:26.867486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 10/21] 10.222.0.78 () {56 vars in 1322 bytes} [Fri Aug 19 00:52:26 2022] GET /identity/v3/role_assignments?user.id=9fd2a745f79241bebdcc3d551a59c8f5&scope.domain.id=default&role.id=b63e277927a74d40a291769119d60894 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:29.352585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecd4-d514-4520-ae54-53dfbed88ad3 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.353598 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecd4-d514-4520-ae54-53dfbed88ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.354057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecd4-d514-4520-ae54-53dfbed88ad3 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.355640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 12/22] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:29.356621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91e64-4359-40c9-9ca3-6a166e8337df None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.357023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91e64-4359-40c9-9ca3-6a166e8337df None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.357198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91e64-4359-40c9-9ca3-6a166e8337df None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.358503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 11/23] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:52:29.363553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610e30-40bd-4a83-8fe8-9db94854ae38 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.364062 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610e30-40bd-4a83-8fe8-9db94854ae38 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.364541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610e30-40bd-4a83-8fe8-9db94854ae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.372740 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd571-2480-469c-900d-53c7184eb560 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.373836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd571-2480-469c-900d-53c7184eb560 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.375331 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd571-2480-469c-900d-53c7184eb560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.404882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-39610e30-40bd-4a83-8fe8-9db94854ae38 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:29.406514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-39610e30-40bd-4a83-8fe8-9db94854ae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:29.419089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-672cd571-2480-469c-900d-53c7184eb560 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:29.420566 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-672cd571-2480-469c-900d-53c7184eb560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:29.583256 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 13/24] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:29.598510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 12/25] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:29.782962 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a5fb-a1b5-4ccd-ac18-f093f81ceb12 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.783579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a5fb-a1b5-4ccd-ac18-f093f81ceb12 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.784098 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a5fb-a1b5-4ccd-ac18-f093f81ceb12 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.785915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 14/26] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:29.791880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.792420 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.792929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.820435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8a78-be87-46cd-b856-c49985e5f8d8 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.821083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8a78-be87-46cd-b856-c49985e5f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.821549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d8a78-be87-46cd-b856-c49985e5f8d8 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.823053 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 15/27] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:52:29.824237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:29.825639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:29.838258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:29.838794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:29.839270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:29.871440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:29.873769 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:29.881030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:29.959233 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 13/28] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:30.023347 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 16/29] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:52:30.075049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.094322 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.134082 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:30.268991 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8c4e-72d8-48e9-9468-56065704de6b None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.304063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6889d-95ef-4c0d-a8a1-3a531596dc0b None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.325670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:30.326671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.327140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.327611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.352264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:30.365507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:30.366240 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.366731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.367150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.367953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:30.369539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:30.369652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:30.370899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:30.371928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 14/30] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:30.377320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.417296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:30.528557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 17/31] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Aug 19 00:52:30 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:30.532089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.541482 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfd8e-f12d-4170-9c77-35064eb4febf None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.623941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:30.624886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.625378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.625824 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.626686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:30.627184 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:30.628790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:30.661548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 15/32] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:30.662181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.685318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:30.713053 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70203a0-1f07-48db-9596-8469629c4276 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.753066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:30.754188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.754667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.755242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.756116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:30.758066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:30.777787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 18/33] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Aug 19 00:52:30 2022] POST /identity/v3/roles => generated 225 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:30.779225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:30.829294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:30.868703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9a3d1-63e9-48eb-a26c-a7e085eed311 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.935230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:30.936251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.937084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.937559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.962462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03eade-242b-4bdb-8b4f-5d0afe50ee2b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:30.963284 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:30.964817 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-6a18dbd8-6c5c-4d79-a12a-10eb7ae3a9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:52:30.983054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:30.983966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:52:30.985495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:52:30.985495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:52:30.985495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:30.985495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 16/34] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:30.988931 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f88fc-23a1-4e79-988e-f756b5c0c8a0 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:30.989296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f88fc-23a1-4e79-988e-f756b5c0c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:30.989543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f88fc-23a1-4e79-988e-f756b5c0c8a0 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:30.991071 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 17/35] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:30.991884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f88fc-23a1-4e79-988e-f756b5c0c8a0 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.011099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.012550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.012839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.013155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.015225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.016721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1863b-144f-432c-8835-62410013ec9c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.018582 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 19/36] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:30 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:31.019867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.020158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.020437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.040953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:31.050930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:31.052468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:31.121379 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f88fc-23a1-4e79-988e-f756b5c0c8a0 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.130879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 20/37] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:31.131841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.158690 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:31.164962 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.165581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.165861 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.166132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.166777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:31.167076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.168489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189b16-700d-4d99-b463-6a7b45f18aba None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.181335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 18/38] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:31.181506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44113-05e3-45b9-9745-50623fb3eed5 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.181785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44113-05e3-45b9-9745-50623fb3eed5 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.181919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44113-05e3-45b9-9745-50623fb3eed5 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.183194 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 19/39] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:31.185857 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d44113-05e3-45b9-9745-50623fb3eed5 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.251605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00b62-e528-461e-94e8-3a709d676ed6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.295317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.295725 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d44113-05e3-45b9-9745-50623fb3eed5 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.295961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.296246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.296524 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.297791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.300011 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8300f-3ab6-439f-a78b-e1d84e5cd404 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.306915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 21/40] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:31.306915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.306915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.306915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.314650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:31.327610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:31.328814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:31.330569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.331263 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.332220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.332220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.332511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.333986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.411141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 22/41] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:31.411141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.472595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 20/42] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:52:31 2022] POST /identity/v3/projects => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:31.473513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.523861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fd480-3ccd-4479-841b-0b72372195d4 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.530684 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:31.568302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.569526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.570061 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.570541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] PATH_INFO: `/v3/domains/default/users/9fd2a745f79241bebdcc3d551a59c8f5/roles/b63e277927a74d40a291769119d60894` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.573162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9fd2a745f79241bebdcc3d551a59c8f5, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.574961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.577937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:31.595731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ffa30-8d36-4afd-bc73-6cc6137bc68c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.597360 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 23/43] 10.222.0.78 () {58 vars in 1361 bytes} [Fri Aug 19 00:52:31 2022] PUT /identity/v3/domains/default/users/9fd2a745f79241bebdcc3d551a59c8f5/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:52:31.648520 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.649610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.650095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.650595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.651495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.653456 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.673828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 21/44] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Aug 19 00:52:31 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:31.751187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:31.866042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65c388-ac0f-4f58-9595-a9492ae8bcb8 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:31.906440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:31.907179 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:31.907455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:31.907725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:31.908851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:31.910345 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6d26-8409-45e9-ac36-b84cb38ab709 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:31.911929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 24/45] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:31.917748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:32.023618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa889-a261-4694-8b70-30ebcf33063a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:32.025914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:32.058225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:32.058837 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:32.059125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:32.059404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:32.060058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:32.061905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded400e-1b45-464e-af55-4c0583354826 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:32.089046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 22/46] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:52:31 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:52:33.793038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc83-439f-4b6d-a50f-9e0b758c84a2 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:33.793583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc83-439f-4b6d-a50f-9e0b758c84a2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:33.793583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc83-439f-4b6d-a50f-9e0b758c84a2 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:33.794936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 25/47] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:33.800411 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e133-325d-47b4-a986-ddc2d4fa422a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:33.800783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e133-325d-47b4-a986-ddc2d4fa422a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:33.801094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e133-325d-47b4-a986-ddc2d4fa422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:33.821079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-6823e133-325d-47b4-a986-ddc2d4fa422a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:33.822641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-6823e133-325d-47b4-a986-ddc2d4fa422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:33.893484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 23/48] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:34.214773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dc83-439f-4b6d-a50f-9e0b758c84a2 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.262728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68895002-a9e9-4420-9d9d-b9a652037edf None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.263021 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68895002-a9e9-4420-9d9d-b9a652037edf None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.263301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68895002-a9e9-4420-9d9d-b9a652037edf None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.265361 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 24/49] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:34.270329 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.270613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.270878 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.282073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:34.289810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:34.291003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:34.323577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dc83-439f-4b6d-a50f-9e0b758c84a2 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.359386 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 25/50] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:34.360263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.361022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.361338 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.361637 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.371967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:34.377071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:34.377913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:34.378664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 26/51] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:34.384156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.401599 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:34.485703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f285e8-e2cb-49f7-b25b-75058a877ae5 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.520430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.521078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.521362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.521644 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.522336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:34.522642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.524033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.533157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 26/52] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:34.539301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.640100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d9782-7710-4ac2-b3cc-223e02b0cc25 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.662975 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:34.674926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.675553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.675834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.676106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.677309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.679008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.680597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 27/53] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:34.686200 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.687484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.770172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:34.789492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7acb6-2de2-45bc-9bf1-b89e05ecf4e6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.794727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d70d-3c43-4752-8d54-13f744664d6c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.826782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.827413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.827693 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.827966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.829114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.830577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.832159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 28/54] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:34.832455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.833233 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.833527 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.833792 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.835066 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.836507 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.837916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.842939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:34.843875 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:34.897252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:34.938962 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7c7b1-e22b-4ea0-877b-fb39fe326263 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.943349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a07ac6-e00a-4c6f-b96d-7e9296a9525e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:34.973083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.973704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.973991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.974268 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.975012 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.976474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b4ec2-b3a8-4b32-9e4e-07d894a64f4b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.977687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:34.978297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:34.978578 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:34.978859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:34.979578 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.domain.id=default, user.id=9fd2a745f79241bebdcc3d551a59c8f5) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:34.979887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:34.981375 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f852f-fd59-4e72-99f8-d3cecdaf7b5a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:34.987698 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 28/56] 10.222.0.78 () {56 vars in 1322 bytes} [Fri Aug 19 00:52:34 2022] GET /identity/v3/role_assignments?user.id=9fd2a745f79241bebdcc3d551a59c8f5&scope.domain.id=default&role.id=b63e277927a74d40a291769119d60894 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:35.015801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 29/57] 10.222.0.78 () {60 vars in 1140 bytes} [Fri Aug 19 00:52:34 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:52:37.179642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f830b-3966-4dc1-9609-d036f335fc29 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:37.180182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f830b-3966-4dc1-9609-d036f335fc29 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:37.180182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f830b-3966-4dc1-9609-d036f335fc29 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:37.181557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 29/58] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:37.188158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:37.188857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:37.189024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:37.216857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:37.218094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:37.296313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 30/59] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:37.613196 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f830b-3966-4dc1-9609-d036f335fc29 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:37.628510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:37.722403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f830b-3966-4dc1-9609-d036f335fc29 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:37.756265 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:37.756992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:37.757269 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:37.757550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:37.758663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:37.760111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd7fb-69b0-415a-92c7-91b22527f92d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:37.761687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 30/60] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:37.767872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:37.815854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:37.887573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec43a3-aca5-4ad6-b432-aeb775176f98 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:37.936802 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:37.937451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:37.937729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:37.938003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:37.938640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:37.940101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd7f5c-60b0-4a12-9270-fa87470db0fd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:37.972758 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 31/61] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:52:37 2022] POST /identity/v3/users => generated 275 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:41.421209 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee3f3-2fd4-4b97-b6d7-8661f8df174e None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.421715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f6bfb-e96b-4e28-b0c1-64f67fd2de34 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.422073 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee3f3-2fd4-4b97-b6d7-8661f8df174e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.422147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f6bfb-e96b-4e28-b0c1-64f67fd2de34 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.422213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee3f3-2fd4-4b97-b6d7-8661f8df174e None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.422276 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f6bfb-e96b-4e28-b0c1-64f67fd2de34 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.423343 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 31/62] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:41.423455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 32/63] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:41.432490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328206-d4fa-4b41-a122-d8787e6df719 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.432676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297997-0571-41d5-ad58-546bd06d4e1a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.432754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328206-d4fa-4b41-a122-d8787e6df719 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.432822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297997-0571-41d5-ad58-546bd06d4e1a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.433064 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328206-d4fa-4b41-a122-d8787e6df719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.433171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297997-0571-41d5-ad58-546bd06d4e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.452571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-8e297997-0571-41d5-ad58-546bd06d4e1a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:41.453815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-8e297997-0571-41d5-ad58-546bd06d4e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:41.458334 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-9f328206-d4fa-4b41-a122-d8787e6df719 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:41.459564 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-9f328206-d4fa-4b41-a122-d8787e6df719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:41.528108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 33/64] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:52:41.604171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:41.789087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a2a3-edc2-4a40-88e3-d99ac0ea5dc9 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.789743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a2a3-edc2-4a40-88e3-d99ac0ea5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.790280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a2a3-edc2-4a40-88e3-d99ac0ea5dc9 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.791830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 34/66] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:41.797149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:41.797439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:41.797718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:41.826263 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:41.827494 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:41.829849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:41.919013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:41.970959 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18a2a3-edc2-4a40-88e3-d99ac0ea5dc9 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:41.979628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.011073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.088981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18a2a3-edc2-4a40-88e3-d99ac0ea5dc9 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.091953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d4e4-42e9-4ae9-9745-508c4a7257e9 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.124353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.125014 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.125295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.125574 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.128471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.129866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.129866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.129866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.136701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:42.141428 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4578e495-5371-427a-9b96-2c68712ebbc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:42.141548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:42.142537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:42.143341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 35/68] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:42.145399 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d4e0e-34aa-48f0-a15e-c02e1280f75f None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.145683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d4e0e-34aa-48f0-a15e-c02e1280f75f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.145955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d4e0e-34aa-48f0-a15e-c02e1280f75f None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 36/69] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830058b5-ae10-40b9-9fe8-920022e56959 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830058b5-ae10-40b9-9fe8-920022e56959 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830058b5-ae10-40b9-9fe8-920022e56959 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 37/70] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:42.152929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830058b5-ae10-40b9-9fe8-920022e56959 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.156643 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-ffe9edc1-cf95-45ae-8fcc-4a9518b0c031 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:42.161633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:42.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:42.163897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 34/71] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:52:42.165389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0467ac-129e-4853-99cd-dd90ced72653 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.165389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0467ac-129e-4853-99cd-dd90ced72653 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.165389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0467ac-129e-4853-99cd-dd90ced72653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.182702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-4c0467ac-129e-4853-99cd-dd90ced72653 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:42.183879 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-4c0467ac-129e-4853-99cd-dd90ced72653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:42.248145 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.261296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 35/72] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:42.262509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.262800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.263074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.275197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830058b5-ae10-40b9-9fe8-920022e56959 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.280985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:42.282163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:42.310822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.311737 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.312017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.312276 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.312958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:42.313261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.314650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.323112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 38/73] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.323733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.357026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 36/74] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:42.358118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.430847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661e84-454c-42b5-99fc-4b180c97eccd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.440128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.468078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.469142 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.469704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.470161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.471082 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:42.471567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.473371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.482355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 39/75] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.488031 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.488616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3733-1e11-4dca-bea9-1349604d2035 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.502112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.530804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.531502 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.531787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.532065 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.545115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:42.550952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:42.551811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:42.552854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 37/76] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:42.558396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.605570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165e1f-44ab-45e7-b72f-3efc125afc90 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.642508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.643064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.643345 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.643620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.659428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.660926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.667746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 40/77] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.667746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.675691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7775e-bc2e-471e-b4a4-deb67d9391a4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.693786 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.710428 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.711065 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.711347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.711642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.712801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.714293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.716059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 38/78] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.716630 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.732026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.770753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6919d4-e079-4005-a0b5-d713b27a938a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.807520 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.808114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.808388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.808655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.809340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:42.809669 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.811397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.819144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3459d-9a0e-4d75-af89-433afe626139 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.819616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 41/79] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.820430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.856020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.856662 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.856971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.857244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.858351 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:42.859786 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:42.861376 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 39/80] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:42.862130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:42.921037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.926433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4638-5341-4dc3-950d-3348f186300e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.954324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:42.960439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.961079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.961360 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.961632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:42.964877 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0969eb-adc8-4df3-bc89-b9cb5009847e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:42.998649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:42.999278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:42.999576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:42.999845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.009877 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:43.014516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:43.015497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:43.016283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 40/81] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:43.017052 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.026965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.028447 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.114191 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97318e0-e81a-4e93-9a73-8b7c2c9f5c51 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.122578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 42/82] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:43.123419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.132221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.152921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.154749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.155515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.155796 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.156125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.221918 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.223341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.224770 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a79de-017c-43a2-80c9-eee7992fa16b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.259043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.259761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.260047 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.260322 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.261573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.263016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.264622 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 43/83] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:43.265424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.328907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 41/84] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:43.329852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.345427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.360806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.363881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cbde6-2ac4-4bc8-b95b-fe808a7dfaa8 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.397343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.397952 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.398232 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.398534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.399174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.400615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.422067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 44/85] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:52:43 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:43.430536 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.432775 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36854-b734-4043-b2e7-a5d60023ec26 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.472246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.472925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.473092 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.473364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.474055 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:43.474650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.476137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.490567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 42/86] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:43.491582 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.547799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effae1-3d50-4f4b-a5d2-ef10fbbb4f13 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.575119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.591254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.592007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.592797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.592797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.593717 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.595163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.597030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 45/87] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:43.597589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.609291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938a0d-855d-48b7-baae-ffc2cb97feb1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.624649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.648264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.648913 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.649198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.649478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.718226 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc42a5-e263-4efc-abb4-46cfddad1868 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.731079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.732548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.760111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.761387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.761702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.761954 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.763251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.765314 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.767712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 46/88] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:43.768783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.824246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.857123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 43/89] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:43.858611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.876647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:43.887248 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a91d7-11b1-4108-a6f9-1b0b9048b49d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:43.929333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:43.930744 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:43.931140 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:43.931743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:43.933014 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:43.935470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:43.938270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 47/90] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:43.940008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:43.971156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c6990-e1fd-469d-a922-4d6791070295 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.009695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.010232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.010528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.010789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.011568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:44.011887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.013632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.019681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 44/91] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:44.020505 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:44.088948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd28-c011-44c1-914b-1c711650ee8a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.093362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:44.161540 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.162240 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.162522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.162799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.163721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=9fd2a745f79241bebdcc3d551a59c8f5) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:44.164036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.165554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.181974 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 48/92] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:43 2022] GET /identity/v3/role_assignments?user.id=9fd2a745f79241bebdcc3d551a59c8f5&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=b63e277927a74d40a291769119d60894 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:44.182856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:44.229158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d873-d4e5-43d7-b4d0-56ed6725352c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.252368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:44.303609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.305286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.305592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.305872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.307994 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.309737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.313439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 45/93] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:44 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:44.320246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:44.372685 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e1996-afb4-464c-a620-35e92df7f40d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.422026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.422660 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.422947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.423221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.514839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099f548-2070-481b-aef4-5ee552ac3b9b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.533710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:44.552627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.554192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.585167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:44.629614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.630544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.631062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.631480 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.632361 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] RBAC: Adding query filter params (role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:44.632810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.634426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.654645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 46/94] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:44 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:44.673513 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 49/95] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:44.679660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:44.847000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c1cc-c7cd-4a7b-9d36-4b8a1803e28d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:44.898557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:44.899231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:44.899518 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:44.899819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] PATH_INFO: `/v3/projects/34761202f622488d85ed4c458ccd2d02` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:44.905620 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] RBAC: Authorizing `identity:get_project(project_id=34761202f622488d85ed4c458ccd2d02)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:44.907158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00f717-8555-40f3-862f-59c2c8897249 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:44.909053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 47/96] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:44 2022] GET /identity/v3/projects/34761202f622488d85ed4c458ccd2d02 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:44.915441 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:45.061980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62a35-d60d-4a48-a513-04fbc4b4eeb4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:45.085658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:45.097881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:45.098428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:45.098709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:45.098992 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:45.099779 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=34761202f622488d85ed4c458ccd2d02, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:45.100089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:45.101594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c8e5a-c33e-4400-aefa-1f299f834ee6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:45.107781 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 50/97] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:44 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=34761202f622488d85ed4c458ccd2d02&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:46.614040 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b41f2-5e75-49a3-b8c3-40d02633c9e4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:46.614719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b41f2-5e75-49a3-b8c3-40d02633c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:46.614719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b41f2-5e75-49a3-b8c3-40d02633c9e4 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:46.616286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 48/98] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:46.630900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5d2c-ba1c-48e2-ad1d-e39c225887cc None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:46.631414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5d2c-ba1c-48e2-ad1d-e39c225887cc None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:46.631516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5d2c-ba1c-48e2-ad1d-e39c225887cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:46.658033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0cdd5d2c-ba1c-48e2-ad1d-e39c225887cc None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:46.659358 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0cdd5d2c-ba1c-48e2-ad1d-e39c225887cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:46.757378 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 51/99] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:46.844852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56a78-a17e-4197-8960-bbef44ff41fe None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:46.845216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56a78-a17e-4197-8960-bbef44ff41fe None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:46.845460 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56a78-a17e-4197-8960-bbef44ff41fe None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:46.846828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 49/100] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:52:46.852275 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc12c5-002e-4aeb-b2ca-90eeead22b06 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:46.852565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc12c5-002e-4aeb-b2ca-90eeead22b06 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:46.852843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc12c5-002e-4aeb-b2ca-90eeead22b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:46.877948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-71dc12c5-002e-4aeb-b2ca-90eeead22b06 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:46.879254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-71dc12c5-002e-4aeb-b2ca-90eeead22b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:46.966916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 52/101] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:47.305726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a145-6b78-4cec-9932-cc35232c4707 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.306017 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a145-6b78-4cec-9932-cc35232c4707 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.306544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a145-6b78-4cec-9932-cc35232c4707 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.308099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 50/102] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:47.314092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.314620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.315093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.336938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:47.338468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:47.344252 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5a145-6b78-4cec-9932-cc35232c4707 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:47.425399 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:47.431111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:47.466824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 53/103] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:47.506555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:47.553390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5a145-6b78-4cec-9932-cc35232c4707 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:47.614226 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:47.614954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.615223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.615496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.617548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:47.618997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13705b93-a54c-4871-bf8b-c3cd156eac1a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:47.625156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 51/104] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:47.625156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1543-c94f-43dc-8c53-6cc3abadaa79 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.625156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1543-c94f-43dc-8c53-6cc3abadaa79 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.625156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1543-c94f-43dc-8c53-6cc3abadaa79 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.625156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 52/105] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:47.629515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1543-c94f-43dc-8c53-6cc3abadaa79 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:47.671066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799c0d-fb2d-4b17-b68d-a9ca38b45482 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:47.714645 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:47.715290 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.715626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.715903 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.726354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-3134053b-2849-4caa-9d70-f0c66ddf45c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:47.731025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:47.731908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:47.733353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 54/106] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:52:47.734261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.734551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.734824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.746902 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1543-c94f-43dc-8c53-6cc3abadaa79 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:47.753253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:47.754436 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:47.756642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:47.785339 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:47.786757 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:47.787768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.788315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.788844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.790405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:47.792219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8320-ce73-4cb3-8625-9a9bfce00676 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:47.826442 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 53/107] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:52:47 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:47.827977 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 55/108] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:47.828746 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbac1-4793-419d-9511-a00bf1fbace9 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.829258 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbac1-4793-419d-9511-a00bf1fbace9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.829660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbac1-4793-419d-9511-a00bf1fbace9 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.831074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 54/109] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:47.833950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:47.840431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:47.841028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:47.842254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:47.882834 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:47.884358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:47.975133 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 55/110] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:47.976339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.089160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.103796 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9e5f6-e6d6-4a06-a8c7-5e5d701a21ca None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.121770 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2273-21fc-4891-8226-ff40f7aae520 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.153762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.154944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.155372 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.155784 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.167933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:48.174689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:48.175761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:52:48.176801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:48.179437 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 56/111] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:48.184939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.184939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.184939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.184939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.185312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:48.185312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.185312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.186833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.206125 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 56/112] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.214132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.259649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.322643 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe556-506b-4102-9f9d-2e854fcd0253 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.370199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b96fc7-6ab5-4582-abd9-6cc5128f3869 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.372561 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.374219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.374608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.374977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.375749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:48.376154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.377689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.389130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 57/113] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.393044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.414104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.421816 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.424048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.424048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.424048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.425033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.426491 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.429258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 57/114] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.430315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.533859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738b154-46fa-48e0-b484-159c7736fce3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.539287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.546127 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f5056-6088-45f8-bc8d-25623e24ba84 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.568828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.569496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.569778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.570082 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.580093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:48.584071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.584870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:48.585213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:48.586214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:48.586982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 58/115] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:48.587629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.587860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.588147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] PATH_INFO: `/v3/users/24fea3e86a0a49a0bbf3d37a158e5253` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.605662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] RBAC: Authorizing `identity:get_user(user_id=24fea3e86a0a49a0bbf3d37a158e5253)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.607127 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.608965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 58/116] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/users/24fea3e86a0a49a0bbf3d37a158e5253 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.609578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.670575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.701225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fadcb5-a256-4c7c-b815-3a795924f7bb None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.728280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee681-fdf1-4edd-bc1a-1d107ba61d78 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.739135 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.739987 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.740279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.740550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.741759 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.743248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad631ab-2a7a-4ad0-a611-0b1812df7d10 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.744908 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 59/117] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.746137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7a29-6238-4c51-a434-5ef0aed4adf1 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.746423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7a29-6238-4c51-a434-5ef0aed4adf1 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.746702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7a29-6238-4c51-a434-5ef0aed4adf1 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.748043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 60/118] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:48.752736 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7a29-6238-4c51-a434-5ef0aed4adf1 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.768862 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.769487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.769771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.770271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.780654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:48.785732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:48.786726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:48.787492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 59/119] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:48.788130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.805504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.870129 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7a29-6238-4c51-a434-5ef0aed4adf1 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.899960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332426b-97f0-45b6-8bd7-65697b2ccdc0 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:48.906859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.908109 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.908533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.908969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:48.910143 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:48.910919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:48.913050 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:48.924680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 61/120] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:48.926118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:48.931162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:48.936987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:48.937619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:48.937902 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:48.938228 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.019153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.020751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.036339 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.036789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba106-6dcf-44ea-beab-8c7ef204070d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.073220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.073889 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.074171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.074443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/users/8f650ea91a9048b092d3250b32193f17/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.076397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, user_id=8f650ea91a9048b092d3250b32193f17, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.077894 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e1ba0-5094-4019-b96d-10c420c428c3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.092156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:52:48 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/users/8f650ea91a9048b092d3250b32193f17/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:52:49.093468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833675b-faee-497e-885d-2ab771d03388 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.093759 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833675b-faee-497e-885d-2ab771d03388 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.094036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833675b-faee-497e-885d-2ab771d03388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.119219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1833675b-faee-497e-885d-2ab771d03388 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:49.120429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1833675b-faee-497e-885d-2ab771d03388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:49.145580 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 60/122] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:49.146918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.206755 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.231506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 63/123] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:49.232915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833675b-faee-497e-885d-2ab771d03388 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.308417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f83c36-846e-435d-95bc-00ccc379d994 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.324951 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.345302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.345913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.346196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.346471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.347143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:49.347464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.349037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.357519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 61/124] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.361750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.433402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833675b-faee-497e-885d-2ab771d03388 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.470368 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.470935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.471218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.471493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.473228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.474766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.477493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 64/125] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.484128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.524920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ac50-fe2b-4145-848e-e853cec4f00c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.562818 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.563466 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.563750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.564026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.566577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.568589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.570262 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 62/126] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.571030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.594879 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.653293 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.679135 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f07895-15c2-4006-84f4-eb437d8ec25e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.709282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a5de3-9db7-451c-8a4f-f81031b43c51 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.734683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.735880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.736186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.736468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.738466 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.740303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.742902 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 65/127] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.745762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.750538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.751180 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.751458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.751738 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.753617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.755568 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.758135 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 63/128] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.761913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.881456 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053725-d446-422f-8d88-b66f35c967d6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.884030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bd09f-e828-4f55-954e-7ef51bd39348 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:49.898453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.919621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:49.922361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.923006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.923346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.923621 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.931372 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:49.932453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:49.933250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:49.933671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:49.934559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=24fea3e86a0a49a0bbf3d37a158e5253) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:49.935319 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:49.935918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:49.937457 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:49.941824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:49.942973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:49.943940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 64/129] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:49.944609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:49.946774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 66/130] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/role_assignments?user.id=24fea3e86a0a49a0bbf3d37a158e5253&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=0f173944247c43abb6a067350c664813 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:49.953897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:50.158803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cc8f-715d-403a-8f20-6d76d17bad18 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:50.164959 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0c88-d186-42e2-b1dc-d58636e5bdb6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:50.218887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:50.219253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:50.219553 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.219832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.220104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/users/9fd2a745f79241bebdcc3d551a59c8f5/roles/b63e277927a74d40a291769119d60894` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.220503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.221132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.221639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.222171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, user_id=9fd2a745f79241bebdcc3d551a59c8f5, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:50.223064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:50.223640 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:50.225110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:50.227217 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 65/131] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:49 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:50.228804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:50.251197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 67/132] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:52:49 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/users/9fd2a745f79241bebdcc3d551a59c8f5/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:52:50.252291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:50.325710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:50.434555 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:50.519069 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962917d-315e-439b-ade2-57bbacb92e8d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:50.569927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f04c0-3438-4993-a27b-95023f718c24 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:50.574466 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:50.575094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.575374 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.575647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.576316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:50.576618 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:50.578032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:50.599256 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 66/133] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:50.603874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:50.640988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:50.641668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.641952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.642230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/users/8f650ea91a9048b092d3250b32193f17/roles/04c91b52415947b7ae240c2d7a82ecbd` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.646773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, user_id=8f650ea91a9048b092d3250b32193f17, role_id=04c91b52415947b7ae240c2d7a82ecbd)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:50.648246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8905acb-7750-4148-82d5-50d92188468b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:50.679656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 68/134] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:52:50 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/users/8f650ea91a9048b092d3250b32193f17/roles/04c91b52415947b7ae240c2d7a82ecbd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:52:50.680952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d76f-42d2-430c-82ee-62b5e44b75b8 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.681247 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d76f-42d2-430c-82ee-62b5e44b75b8 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.681528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832d76f-42d2-430c-82ee-62b5e44b75b8 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.682748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 69/135] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:50.694145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.694332 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.694619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.747454 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:50.748738 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:50.811933 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a8e1f-c80a-4a45-96fb-364adf1b3e87 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:50.815459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:50.897511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:50.898179 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:50.898620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:50.898919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:50.900190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:50.901711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:50.902202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 70/136] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:52:50.903698 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 67/137] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:50 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:50.912914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:51.001426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:51.091989 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f24f18-b2a0-443a-87b5-0003f5341bec None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:51.141639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:51.142316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.142604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.142886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] PATH_INFO: `/v3/projects/34761202f622488d85ed4c458ccd2d02` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.144163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] RBAC: Authorizing `identity:get_project(project_id=34761202f622488d85ed4c458ccd2d02)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:51.149892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:51.149892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 71/138] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:50 2022] GET /identity/v3/projects/34761202f622488d85ed4c458ccd2d02 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:51.155953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:51.371130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223406-e39b-4ae5-a7e5-ec27862df3ef None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:51.376760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:51.449855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:51.450805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.451246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.451662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] PATH_INFO: `/v3/projects/34761202f622488d85ed4c458ccd2d02/users/8f650ea91a9048b092d3250b32193f17/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.457644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] RBAC: Authorizing `identity:create_grant(project_id=34761202f622488d85ed4c458ccd2d02, user_id=8f650ea91a9048b092d3250b32193f17, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:51.459415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:51.483150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 68/139] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:52:51 2022] PUT /identity/v3/projects/34761202f622488d85ed4c458ccd2d02/users/8f650ea91a9048b092d3250b32193f17/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:52:51.556147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c687-a97e-4b90-aec7-9f1c502f009f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:51.572985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:51.608227 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:51.608924 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.609211 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.609489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.610787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:51.612246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a484a46-b13f-4ef1-a2f5-a924b553f87f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:51.613936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 72/140] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:51.619913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:51.668923 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:51.757980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b235a6-6205-4634-a8b6-ee0f12976b2b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:51.799957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:51.800977 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.801461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.801981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.802891 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:51.804553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb13da-9a74-4f81-b36e-abd748071801 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:51.835043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 69/141] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:52:51 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:51.926035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf8cd-b0c0-4e72-af9e-2a6d4f7aa836 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.926532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf8cd-b0c0-4e72-af9e-2a6d4f7aa836 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.926638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf8cd-b0c0-4e72-af9e-2a6d4f7aa836 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.928545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 73/142] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:51.934091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:51.934723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:51.935205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:51.962130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:51.963695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:52.063692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 70/143] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:52.448675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbf8cd-b0c0-4e72-af9e-2a6d4f7aa836 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:52.569650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbf8cd-b0c0-4e72-af9e-2a6d4f7aa836 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:52.608012 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:52.608654 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:52.608953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:52.609228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:52.619568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:52.624293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:52.625166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:52.625947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 74/144] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:52.631446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:52.649085 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:52.742359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb0f0d-19df-4f0f-b015-370fa9ed9adc None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:52.790134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:52.790733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:52.790998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:52.791270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:52.792016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:52.792338 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:52.793796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:52.807798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 71/145] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:52.814273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:52.859793 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:52.931593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19d75-b7e0-47bd-9ecd-bf67fbcd4a14 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:52.971393 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:52.972038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:52.972312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:52.972578 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:52.973900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:52.975566 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:52.977214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 75/146] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:52 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:52.982938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:53.089706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:53.105953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b4b-f322-4275-a63e-390793098131 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:53.152771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:53.153330 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.153609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.153881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.257896 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:53.259404 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:53.363326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:53.393599 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 72/147] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:53.399540 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:53.561672 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81f73-1499-4786-97fd-b8ff355d5687 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:53.570063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:53.598436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:53.599280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.599656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.599935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.601146 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:53.602662 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4a2d-8bdc-41e7-950b-bfb33aa8f935 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:53.604332 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 76/148] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:53 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:53.612544 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:53.753109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3fca6-5080-4e64-a994-14eef066de2e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:53.794593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:53.795440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.795879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.796309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.797209 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:53.797694 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:53.799431 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e84d0-095b-4258-9d5e-48a6c0eaad3f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:53.805995 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 73/149] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:53 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:53.827600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9373d6-aaa5-4608-885f-c74139d00020 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.827846 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9373d6-aaa5-4608-885f-c74139d00020 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.828128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9373d6-aaa5-4608-885f-c74139d00020 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.829570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 77/150] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:53.840866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.841396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.841828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.869769 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:53.871252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:53.926323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:53.953613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bdb9-0efb-40bd-90ad-5431e619dd48 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.954160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bdb9-0efb-40bd-90ad-5431e619dd48 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.954160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bdb9-0efb-40bd-90ad-5431e619dd48 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:53.956875 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 78/151] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:53.966209 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 74/152] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:53.967534 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:53.967823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:53.968122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:54.005937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:54.007173 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:54.122572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 79/153] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:54.678316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:54.778918 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:54.827083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b6c5-c7f4-4d06-baf4-90453a9a2ec8 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:54.893602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:54.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:54.894516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:54.894784 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:54.929051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1d58cd02-eacf-4d94-9081-74b947a507dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:54.934671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:54.935921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:54.936696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:54.937327 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 75/154] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:54.949141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42720c2-4490-4d85-ae66-93a07bf6bc84 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:54.949440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42720c2-4490-4d85-ae66-93a07bf6bc84 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:54.949691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42720c2-4490-4d85-ae66-93a07bf6bc84 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:54.951234 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 76/155] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:54.951778 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42720c2-4490-4d85-ae66-93a07bf6bc84 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:54.981747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6007b-3f14-4f9c-9ddc-f86690395201 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:54.992217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.021426 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.063618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.064275 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.064554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.064823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.113522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f233aed1-35a3-4857-bd2b-14b7db8e01ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:55.119159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:55.119997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:55.120979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 80/156] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:52:55.121711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.121774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.122346 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.163446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42720c2-4490-4d85-ae66-93a07bf6bc84 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:55.182201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:55.183339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:55.225618 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.226244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.226563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.226871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.227547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:55.227853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:55.229305 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:55.251035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 77/157] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:55.252004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:55.347995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 81/158] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:55.349111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:55.397018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.404995 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c713-1e79-48da-8357-87649dcc416a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:55.443457 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.443984 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.444318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.444714 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.445522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:55.445830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:55.447307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e7f5-5259-47ac-b878-9a0dd61c3097 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:55.458091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 78/159] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:55.459743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2b22-8695-4b85-8b51-2fae8486f705 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.460051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2b22-8695-4b85-8b51-2fae8486f705 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.460588 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2b22-8695-4b85-8b51-2fae8486f705 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.464741 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 79/160] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:55.466090 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e2b22-8695-4b85-8b51-2fae8486f705 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:55.517521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.528157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c375a-ce18-4d5e-a0b4-c0dc47a68a06 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:55.592823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.594580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.594863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.596136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] PATH_INFO: `/v3/users/9fd2a745f79241bebdcc3d551a59c8f5` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.598875 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] RBAC: Authorizing `identity:get_user(user_id=9fd2a745f79241bebdcc3d551a59c8f5)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:55.600351 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554000c-8993-4da6-822d-e7f9b22b30cf None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:55.602315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 82/161] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:55 2022] GET /identity/v3/users/9fd2a745f79241bebdcc3d551a59c8f5 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:55.607037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.607326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.607658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.629172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:55.630632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:55.689658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e2b22-8695-4b85-8b51-2fae8486f705 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:55.703410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 83/162] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:55.707582 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:55.776318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.777369 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.777841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.778317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] PATH_INFO: `/v3/users/24fea3e86a0a49a0bbf3d37a158e5253` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.779642 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=24fea3e86a0a49a0bbf3d37a158e5253)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:55.781417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:55.786876 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 80/163] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:55 2022] GET /identity/v3/users/24fea3e86a0a49a0bbf3d37a158e5253 => generated 289 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:55.792776 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:55.840919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.842495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:55.858435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded53bc-eab3-4a07-bafe-9a5e0ca0bcc8 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:55.914114 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:55.914688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:55.914988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:55.915262 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:55.958975 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34e406-b021-4c3b-bc2d-2a88c9bfa4a7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.009159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.010517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.018107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.019060 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.019536 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.020036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.022188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.023879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.025927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 81/164] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:55 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:56.032092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.109294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.124516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 84/165] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:56.125472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.156766 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.168396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4750ef-b768-4f5e-9717-914d4bda8812 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.205448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.207806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.208907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.209434 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/users/24fea3e86a0a49a0bbf3d37a158e5253/roles/0f173944247c43abb6a067350c664813` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.211696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, user_id=24fea3e86a0a49a0bbf3d37a158e5253, role_id=0f173944247c43abb6a067350c664813)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.213511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.233547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 82/166] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:52:56 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/users/24fea3e86a0a49a0bbf3d37a158e5253/roles/0f173944247c43abb6a067350c664813 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 00:52:56.234867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.282934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3a97-8ac7-4f0e-b950-b71f56c8c8ba None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.367883 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.368569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.368856 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.369171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.395324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:56.400685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:56.401669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:56.402735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 85/167] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:56.415978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.443795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925c4de-60b3-4fbb-a07c-13aa6f2f6186 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.516855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.517538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.517819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.518096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.521575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.523085 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.524836 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 83/168] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:56.525646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.535855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.587984 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.642837 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012f26-5196-47f0-98a1-f0c62da4df0e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.685218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.686163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.686445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.686716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.687398 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:56.687699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.689169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.699090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 86/169] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:52:56.699937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.720587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1dee-9aee-4081-8fff-319bf09592da None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.764749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.765681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.765961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.766260 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.781146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-e98eb24a-2823-4d18-af3d-88516f57ea03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:56.787712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:56.789589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:56.790897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 84/170] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:56.794668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b307f-d229-4db7-ad7f-06bea6e59133 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.794668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b307f-d229-4db7-ad7f-06bea6e59133 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.794668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b307f-d229-4db7-ad7f-06bea6e59133 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.795142 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 85/171] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:56.796252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb9c9-bea2-4cb9-8813-1e1305efeb24 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.797205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb9c9-bea2-4cb9-8813-1e1305efeb24 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.797711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb9c9-bea2-4cb9-8813-1e1305efeb24 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.799786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 86/172] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:56.801148 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fb9c9-bea2-4cb9-8813-1e1305efeb24 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.837883 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f68ce-ad73-4336-bfd2-4a32da166bbb None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:56.859802 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.888267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:56.889744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:56.890225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:56.890706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:56.892284 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=9fd2a745f79241bebdcc3d551a59c8f5) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:56.892795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:56.893982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:56.895797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:56.904223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 87/173] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/role_assignments?user.id=9fd2a745f79241bebdcc3d551a59c8f5&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=b63e277927a74d40a291769119d60894 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:56.905952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:56.921382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fb9c9-bea2-4cb9-8813-1e1305efeb24 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.002469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.003433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.003907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.004357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.007843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:57.009629 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd48d0-5e76-4f7b-a291-fecfd8ef15c7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:57.011859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 87/174] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:57.016459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.018609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.019092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.062238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:57.063554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:57.080115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7679-b764-43d2-bb62-8c92c18d3fd9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.133799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.134841 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.135314 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.135776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.136645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:57.137171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:57.138887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd68d24-2429-43d2-ba50-ceaddadf7310 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:57.167680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 88/175] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:57.167680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.167680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.167680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.205365 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:57.208639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:57.212424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 88/176] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:57.215348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:57.320996 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:57.371005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:57.404527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31524b-801c-499d-bcc8-826829fdf0ca None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.439962 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 89/177] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:57.441424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:57.451264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.451930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.452216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.452492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.571952 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:57.573766 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:57.613070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0a45-f863-4729-bc29-e2e1fa20f1ea None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.649896 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.650535 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.650930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.651193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] PATH_INFO: `/v3/users/8f650ea91a9048b092d3250b32193f17` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.652634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=8f650ea91a9048b092d3250b32193f17)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:57.653906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba127d0-4874-4471-b7fd-3ba541dc1ac4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:57.655933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 90/178] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:57 2022] GET /identity/v3/users/8f650ea91a9048b092d3250b32193f17 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:57.657474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b288-c271-49b4-9b8a-f7bc5398ee2a None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.657474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b288-c271-49b4-9b8a-f7bc5398ee2a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.657760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60b288-c271-49b4-9b8a-f7bc5398ee2a None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.663370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 91/179] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:57.664202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60b288-c271-49b4-9b8a-f7bc5398ee2a None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:57.667235 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:57.698118 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 89/180] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:57.699205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:57.714048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:57.783706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60b288-c271-49b4-9b8a-f7bc5398ee2a None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.825945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.826762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.827069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.827314 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.828976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff915-6fc1-48a8-92ba-1d2826f3cf4c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:57.839747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-01c0db7a-6c7b-4eb2-b4b7-5621def1bd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:57.844766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:57.845673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:52:57.846474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 92/181] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:57.847138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.847683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.847683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.867629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:57.867798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:57.868432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:57.868712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:57.868926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:57.869021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:57.918032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:57.940659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 93/182] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:57.945063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:57.951465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:57.953676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:57.970818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.046205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a974869-3150-462a-a187-ad2a02cd1678 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.080809 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 90/183] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:58.081805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.083831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.085150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.085624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.086084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.087551 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.089229 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.091358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 94/184] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:57 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.092304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.173516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.196102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.197339 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5ae0-ae8b-4303-9b58-db92b56be5e4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.204438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ae010-fe86-4fe0-b4e4-54e1c1e56c5b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.232208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.232841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.233137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.233406 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.244342 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:52:58.248584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:52:58.251967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:52:58.252842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 91/185] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:52:58.253672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.255270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.255781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.256250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.257485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:58.258000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.259597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.269517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 95/186] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.270925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.372942 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5dcbd-ae5f-4646-84c0-2100c2b8b1f2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.379912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2324-1d53-48d3-a4fc-1329fa628dcb None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.413775 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.414278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.414611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.414886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.414980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.415166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.415256 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] PATH_INFO: `/v3/projects/34761202f622488d85ed4c458ccd2d02` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.415440 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.416259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] RBAC: Adding query filter params (role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:58.416569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.416695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] RBAC: Authorizing `identity:get_project(project_id=34761202f622488d85ed4c458ccd2d02)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.418097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.418316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.420013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 92/187] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/projects/34761202f622488d85ed4c458ccd2d02 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.420834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.429726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 96/188] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.430396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.435066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.464876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.556459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65875a2-4cbf-4ab4-97f5-9a45bbee5bad None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.587823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5dec-f774-4e28-b793-8fd5ab370229 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.596214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.596871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.597225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.597503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.599123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.600612 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.606681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 97/189] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.606681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.637557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.638246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.638591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.638928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.639855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:58.640219 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.642091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.653759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 93/190] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.658050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.725493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.740169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e5fec-07b1-4605-99b6-0b3aed906f99 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.752033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:58.780337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.781007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.781291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.781568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.797203 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b6cd8-2f2a-4bca-903f-fb4c645671ac None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.798174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.799661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.806487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 98/191] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.806487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.842313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.843499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.843775 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.844043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.844759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=34761202f622488d85ed4c458ccd2d02, user.id=8f650ea91a9048b092d3250b32193f17) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:52:58.845095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.846539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:58.860919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 94/192] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/role_assignments?user.id=8f650ea91a9048b092d3250b32193f17&scope.project.id=34761202f622488d85ed4c458ccd2d02&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:58.860919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:58.945852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0024e-d6b2-40b8-885e-a10799854233 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.981068 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac52d-1236-42df-b2b6-0667ea8a7fbe None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:58.994279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:58.994919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:58.995186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:58.995455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:58.996107 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:58.998520 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.025178 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.031385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:59.032480 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.033147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.033751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.036081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:59.037134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 99/193] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:52:58 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:52:59.037926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21faf2bb-ab8c-4b51-acb3-6d23d891e011 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.039156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.039754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 95/194] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:52:58 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:59.041099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4c1-9c03-4075-baa9-b22de4fe66a7 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.041346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4c1-9c03-4075-baa9-b22de4fe66a7 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.045084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4c1-9c03-4075-baa9-b22de4fe66a7 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.045084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 96/195] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:52:59.049073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4c4c1-9c03-4075-baa9-b22de4fe66a7 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.050769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.211545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439f9-e211-4a9f-a0f6-b03ac2022fcf None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:59.217552 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4c4c1-9c03-4075-baa9-b22de4fe66a7 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:59.261579 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:59.262213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.262493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.262777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.268448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:59.269532 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.269946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.270404 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.346031 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:59.347637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.351435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.358190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.362214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:59.364821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9660475-c984-43d7-88e9-086ac0c4b342 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.494556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 97/196] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:59.496177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 100/197] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:52:59.496605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.497152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.497692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.510040 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.518706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:52:59.520441 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:52:59.609462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 98/198] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:52:59.610630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.650046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.651163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de42788-5737-4b64-b9ba-29831a2e59bd None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:59.655272 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:52:59.739284 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:59.740228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.740713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.741215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.742925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:59.744550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.746935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 101/199] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:59.770054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.775607 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14044a76-527d-4392-a74c-b15d94dbea33 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:59.818374 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:52:59.819396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:52:59.819892 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:52:59.820355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:52:59.821906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:52:59.824018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:52:59.826208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 99/200] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:52:59.833282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:52:59.973194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a5069-ea5d-4b44-89b8-2d51cff9a438 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:52:59.977306 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:00.012983 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.013947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.014434 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.014891 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.015802 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=d30d378fb68b4a0ba064a38337a7bc70) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:00.016304 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:00.017947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:00.024339 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 100/201] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/role_assignments?user.id=d30d378fb68b4a0ba064a38337a7bc70&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=b63e277927a74d40a291769119d60894 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:00.025538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:00.058178 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f37-459b-4bd9-bb3c-259ac9ebda16 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:00.097041 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.098231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.098954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.099503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.100445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] RBAC: Adding query filter params (role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=d30d378fb68b4a0ba064a38337a7bc70) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:00.101023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:00.102724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:00.109833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 102/202] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:52:59 2022] GET /identity/v3/role_assignments?user.id=d30d378fb68b4a0ba064a38337a7bc70&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:00.154137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057ee6-940f-4754-aec0-f628cf63bacc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:00.196401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.197083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.197365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.197640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.210830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:00.215682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:00.216590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:00.217507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:00.221312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 101/203] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:00.226090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:00.283213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:00.357794 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbaa562-80cf-438e-8c85-77fe4fcfc220 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:00.399540 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.400232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.400532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.400800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.401602 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:00.402184 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:00.403573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:00.418217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 103/204] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:00.419746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:00.446812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:00.527831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd3e8-696a-41b4-98c0-357a5f37070f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:00.563284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.563839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.564164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.564444 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] PATH_INFO: `/v3/users/24fea3e86a0a49a0bbf3d37a158e5253` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.565597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] RBAC: Authorizing `identity:get_user(user_id=24fea3e86a0a49a0bbf3d37a158e5253)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:00.567104 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:00.573304 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 102/205] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:00 2022] GET /identity/v3/users/24fea3e86a0a49a0bbf3d37a158e5253 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:00.574996 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:00.699967 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:00.704183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c0369-8589-499d-a90a-64a4968f8eb9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:00.739388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:00.740019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:00.740301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:00.740574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:00.820195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:00.821669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:00.940106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:00.945030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 104/206] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 00:53:00.950933 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:01.049559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:01.060623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2e8a-9b7f-4c8c-97ca-59de3bb3774a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:01.096165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:01.096728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:01.097038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:01.097310 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:01.098798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:01.100239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13838-070b-4800-b131-82b1713948fa None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:01.101882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 103/207] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:00 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:01.108034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:01.231851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154544b4-7244-41e6-81e8-98eed36fdc95 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:01.274516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:01.275138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:01.275416 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:01.275790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:01.276524 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, scope.project.id=60382a301fa147febfb309284f9b660c, user.id=24fea3e86a0a49a0bbf3d37a158e5253) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:01.276830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:01.282013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d2878-1243-4eba-acb9-2f8417184440 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:01.290287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 105/208] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:01 2022] GET /identity/v3/role_assignments?user.id=24fea3e86a0a49a0bbf3d37a158e5253&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=0f173944247c43abb6a067350c664813 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:01.741476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b94e9-64d7-45b4-bec3-a6b20d7ee1ae None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:01.741758 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b94e9-64d7-45b4-bec3-a6b20d7ee1ae None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:01.742036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b94e9-64d7-45b4-bec3-a6b20d7ee1ae None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:01.743383 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 104/209] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:01.748861 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc631a-bfa5-4618-9cdb-3bbe5fd5b358 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:01.749282 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc631a-bfa5-4618-9cdb-3bbe5fd5b358 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:01.749653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc631a-bfa5-4618-9cdb-3bbe5fd5b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:01.769333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-84bc631a-bfa5-4618-9cdb-3bbe5fd5b358 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:01.770747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-84bc631a-bfa5-4618-9cdb-3bbe5fd5b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:01.834731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:01.850149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 106/210] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:02.217314 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b94e9-64d7-45b4-bec3-a6b20d7ee1ae None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.228668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69e7f-e91b-460c-b14a-4ddf6a94a037 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.229892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69e7f-e91b-460c-b14a-4ddf6a94a037 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.230408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69e7f-e91b-460c-b14a-4ddf6a94a037 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.232581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 107/211] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:02.240287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.240862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.241355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.264755 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:02.265966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:02.331496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b94e9-64d7-45b4-bec3-a6b20d7ee1ae None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:02.366399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 108/212] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:02.367904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:02.368768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.369254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.369779 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.381101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:02.386121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:02.386991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:02.387786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:02.390326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 105/213] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:02.398289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.509369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50844ad4-9fa2-48ab-9dad-54741100e0f9 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:02.532691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:02.545025 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:02.545761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.546217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.546558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.547597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:02.547899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:02.549405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180b49-f6c2-4ad8-aaf7-5c33408a85e3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:02.558616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 109/214] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:02.564757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.582695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eb39-a6af-4124-9304-06bad020cf37 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.583377 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eb39-a6af-4124-9304-06bad020cf37 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.583377 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05eb39-a6af-4124-9304-06bad020cf37 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.584449 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 110/215] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:02.589415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.589702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.589978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.591603 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:02.608682 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:02.609832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:02.682920 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 111/216] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:02.702944 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504b20-8952-4452-b992-f03254d6eacd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:02.713589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.747666 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:02.748633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.749112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.749551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] PATH_INFO: `/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.768729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] RBAC: Authorizing `identity:get_user(user_id=e0c8c9bf660e4907b4b2be2f3f5de445)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:02.770616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:02.777475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 106/217] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:02 2022] GET /identity/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:02.779682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.825014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9096a09-427e-4778-897c-ae8cf7322160 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:02.841424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:02.863165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:02.864023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.864136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.864352 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.865464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:02.866900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5d9e9-714a-4108-8bc8-07d28b779451 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:02.868438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 112/218] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:02.869569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9deb-a0b2-4373-a030-71af4029e736 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.869842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9deb-a0b2-4373-a030-71af4029e736 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.870105 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9deb-a0b2-4373-a030-71af4029e736 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.871429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 113/219] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:02.875989 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e9deb-a0b2-4373-a030-71af4029e736 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:02.876202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:02.902868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8214-0754-4afb-99e1-647fa7696f56 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:02.938205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:02.938817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:02.939092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:02.939414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:02.981425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e9deb-a0b2-4373-a030-71af4029e736 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.011306 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.012920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.017701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.018318 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.018594 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.018930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.019513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.021124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ac560-af56-45e7-80c8-42291992deda None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.044942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 114/220] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:02 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:03.045147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.045318 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.045587 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.065876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:03.067831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:03.104183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.108409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.135662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 107/221] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:03.136368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.153018 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 115/222] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:03.157149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.270905 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5114-4168-4c73-b542-fa23889d371c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.311307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd05f5-6a37-4bb4-8b45-590e4e77150d None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.317512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.318423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.318877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.319320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.329927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:03.335721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:03.336650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:03.337510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 108/223] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:03.342531 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.362802 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.363559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.363841 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.364110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.366063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.367528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.369618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 116/224] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:03.377610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.392076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.421117 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.474942 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539feb91-4a20-4f85-832d-c48a37ee35ee None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.517458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.518110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dad4-f47d-4a81-a093-c1d908d1ef04 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.518266 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.518502 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.518834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.519562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:03.520032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.521602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.531093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 109/225] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:03.532056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.567967 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.568916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.569642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.570092 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.571932 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=e0c8c9bf660e4907b4b2be2f3f5de445) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:03.572426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.574089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.582483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 117/226] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/role_assignments?user.id=e0c8c9bf660e4907b4b2be2f3f5de445&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:03.583622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.698639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.708156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:03.710386 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23a296-d06f-4507-a661-2e7f8190f08b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.712216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb427-f38f-4ecb-aef5-d371a6ceb1b4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.754369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.755486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.755940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.756373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.757804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.759681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.762134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 118/227] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:03.767612 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.789412 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.790446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.790929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.791435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.808379 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:03.814826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:03.815760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:03.816718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:03.820419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 110/228] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:03.829177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:03.944268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b687353-dbf7-47d7-9c48-c58f5e041fea None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:03.982719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:03.983362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:03.983646 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:03.983917 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:03.985201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:03.987255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:03.990568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 119/229] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:03.999157 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46eff-a03a-4219-8a8b-39062f9755f2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:04.002489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:04.040850 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:04.042946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:04.044922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:04.045968 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:04.047028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:04.048369 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:04.052476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:04.065219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:04.074943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 111/230] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:04.082540 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:04.115087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:04.179741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bd3f5-1e6f-430c-8b3f-33475a6bd9b2 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:04.204104 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6516-5a82-4e33-b3d9-9d4fc8462d71 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:04.241606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:04.242287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:04.242586 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:04.242844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/d30d378fb68b4a0ba064a38337a7bc70/roles/b63e277927a74d40a291769119d60894` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:04.244031 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:04.244937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user_id=d30d378fb68b4a0ba064a38337a7bc70, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:04.245215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:04.245684 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:04.246212 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:04.246468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:04.247831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:04.249594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:04.251511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 112/231] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:04 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:04.257935 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:04.269022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 120/232] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:04 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/d30d378fb68b4a0ba064a38337a7bc70/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:04.361250 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:04.373719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd562-7372-4328-b0c4-48da7b616478 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:04.416170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:04.416827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:04.417116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:04.417384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:04.421606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:04.423146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e65aa-278b-4bc7-bc16-b9f4a0c1cf57 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:04.425316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 113/233] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:04 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:04.431422 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:04.537207 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:04.543174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28143d0-0fa8-4314-8968-fd3afb55e0f6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:04.581599 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:04.582316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:04.582595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:04.582864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/d30d378fb68b4a0ba064a38337a7bc70/roles/04c91b52415947b7ae240c2d7a82ecbd` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:04.585112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user_id=d30d378fb68b4a0ba064a38337a7bc70, role_id=04c91b52415947b7ae240c2d7a82ecbd)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:04.586628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecfee4-9131-44af-8994-a0b56c291dfb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:04.603585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 121/234] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:04 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/d30d378fb68b4a0ba064a38337a7bc70/roles/04c91b52415947b7ae240c2d7a82ecbd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:05.738417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859c5a-f1a9-48d2-979e-363c610e0f4a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:05.739573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859c5a-f1a9-48d2-979e-363c610e0f4a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:05.739573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859c5a-f1a9-48d2-979e-363c610e0f4a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:05.740684 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 114/235] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:05.745980 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462d8-451a-44d2-9b33-1ab0ddebf042 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:05.746390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462d8-451a-44d2-9b33-1ab0ddebf042 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:05.746555 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71462d8-451a-44d2-9b33-1ab0ddebf042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:05.773168 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b71462d8-451a-44d2-9b33-1ab0ddebf042 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:05.774380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b71462d8-451a-44d2-9b33-1ab0ddebf042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:05.867586 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 122/236] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:06.140259 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11f9f-bcda-42a8-b62d-042cfd0c4d9d None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.140639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11f9f-bcda-42a8-b62d-042cfd0c4d9d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.140811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11f9f-bcda-42a8-b62d-042cfd0c4d9d None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.142174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 115/237] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:06.148482 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5772-1ab2-45ea-9969-2f606a7775fa None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.148765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5772-1ab2-45ea-9969-2f606a7775fa None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.149134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5772-1ab2-45ea-9969-2f606a7775fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.174314 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d24f5772-1ab2-45ea-9969-2f606a7775fa None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:06.175552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d24f5772-1ab2-45ea-9969-2f606a7775fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:06.256914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 123/238] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:06.338941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11f9f-bcda-42a8-b62d-042cfd0c4d9d None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:06.419546 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25352-2687-456b-9675-6707d400d156 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.419842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25352-2687-456b-9675-6707d400d156 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.420036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25352-2687-456b-9675-6707d400d156 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.422175 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 124/239] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:06.427155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.427609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.428034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.448699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:06.450904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:06.462795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:06.483046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11f9f-bcda-42a8-b62d-042cfd0c4d9d None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:06.547680 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:06.549527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.551041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.551754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.567056 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 125/240] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:06.581640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:06.587009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:06.587884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:06.588676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:06.591081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 116/241] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:06.597227 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:06.714004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23efbc-5620-4743-9e3f-6bf59492e07e None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:06.747345 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:06.767207 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:06.768556 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.769059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:06.770440 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.770990 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.772696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:06.773234 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:06.774816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:06.789394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 126/242] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:06.791741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:06.807312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:06.920522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6625b81-3105-4f5c-8936-aff754184a54 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:06.952540 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40b84-2843-417c-b3e0-574161dd4ef1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:06.956573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:06.956809 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:06.957158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:06.957432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:06.958545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:06.959998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:06.961583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 117/243] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:06.962460 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.001278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.002281 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.002815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.003288 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] PATH_INFO: `/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.023118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] RBAC: Authorizing `identity:get_user(user_id=aa65d46b9dab4ee9a543cf73ee9510fe)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.025556 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.033754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 127/244] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:06 2022] GET /identity/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:07.034248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.065391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.082659 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a41c0-9a4d-4ca7-b17d-f85f037137a5 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.118748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.119761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.120191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.120666 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.122525 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.132760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:07.137928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:07.138821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:07.139624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 118/245] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:07.140288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.170405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f596-d35e-40a2-886d-a58d8c8e146a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.212326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.213533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.213964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.214240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.214955 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.216459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.241283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 128/246] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:07 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:07.242570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.256798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112217e-7ca8-4213-859d-8ca1df646702 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.311621 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.313225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.313731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.314566 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.340998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.388504 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c34c8-3a3b-4a72-b096-eff24f15e149 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.416077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.426578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.428806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f302d0-518a-4cfe-b724-79ba2932339c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.435316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.435946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.436229 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.436505 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.438829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:07.438829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.438991 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4b1d-3289-4e7b-bdfa-5646dee9b4d6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.448567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 129/247] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:07.450186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757e0f-57f7-4335-84e7-63ef710c6910 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.450733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757e0f-57f7-4335-84e7-63ef710c6910 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.451217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757e0f-57f7-4335-84e7-63ef710c6910 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.452738 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 130/248] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:07.454024 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24757e0f-57f7-4335-84e7-63ef710c6910 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.567915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 119/249] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:07.574428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f335-06d6-4c36-a7fc-82b5b6e020ab None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.574724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f335-06d6-4c36-a7fc-82b5b6e020ab None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.575002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0f335-06d6-4c36-a7fc-82b5b6e020ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.585322 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24757e0f-57f7-4335-84e7-63ef710c6910 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.599076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fdc0f335-06d6-4c36-a7fc-82b5b6e020ab None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:07.600702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fdc0f335-06d6-4c36-a7fc-82b5b6e020ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:07.631679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.632331 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.632614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.632907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] PATH_INFO: `/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.634074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0c8c9bf660e4907b4b2be2f3f5de445)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.635594 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b03d-751c-4adf-9be6-fc6cd8653af8 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.637879 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 131/250] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:07.638415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799822a-48b3-4387-b43f-88502fee66ea None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.638705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799822a-48b3-4387-b43f-88502fee66ea None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.638980 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799822a-48b3-4387-b43f-88502fee66ea None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.640296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 132/251] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:07.640863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799822a-48b3-4387-b43f-88502fee66ea None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.654328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.687965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 120/252] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:07.689506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.689792 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.690067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.711654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:07.712848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:07.753302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:07.795956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 121/253] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:07.796848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.857830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799822a-48b3-4387-b43f-88502fee66ea None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.925297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:07.926151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:07.926426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:07.926774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:07.927968 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:07.929500 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:07.931363 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 133/254] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:07.938135 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:07.981544 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23023c84-f613-4c5a-a505-5863ecfb574e None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:07.995867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.048326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.048992 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.049271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.049542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.057799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.059271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.061683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 122/255] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:08.067765 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.092940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08df8-51f0-4858-ad4a-f8038cc2659a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.114064 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.145257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.146133 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.146554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.146964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.147832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=aa65d46b9dab4ee9a543cf73ee9510fe) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:08.148276 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.149905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.165475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 134/256] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:07 2022] GET /identity/v3/role_assignments?user.id=aa65d46b9dab4ee9a543cf73ee9510fe&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=0f173944247c43abb6a067350c664813 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:08.175392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.298249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c8ac9-313c-41c5-b83e-e202debf76c6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.343110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398a5c-f3d9-41e4-9c51-8a33a0fb06de None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.388737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.389337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.389621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.389895 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.398427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.399112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.399388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.399664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/e0c8c9bf660e4907b4b2be2f3f5de445/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.408250 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user_id=e0c8c9bf660e4907b4b2be2f3f5de445, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.409304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:08.409806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:08.415144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:08.416035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:08.417308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 135/257] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:08.417969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.432337 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 123/258] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:08 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/e0c8c9bf660e4907b4b2be2f3f5de445/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:08.433307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.485038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.495840 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.563377 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853fc4e-3b35-4f53-b0c9-fc62ac17de11 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.609691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.610697 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.611164 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.611621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.635435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:08.645732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:08.646648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:08.647485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:08.652406 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555c479-4e8b-4295-abdc-126e242435af None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.655415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 136/259] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:08.661641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.737675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.738761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.739230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.739706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.740578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:08.746403 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.748095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.764767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 124/260] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:08.771926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.872799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f9b9-af46-44df-ada3-608f5c8a2f50 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.877915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.895357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:08.904501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f284e-5b44-4c26-91f0-abc7f831523c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:08.941968 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.942595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.942884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.943211 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.943896 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:08.944204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.945756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.951503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:08.952478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:08.952971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:08.953435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:08.955117 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:08.956924 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:08.959440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 125/261] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:08.964553 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 137/262] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:08.965170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:08.970128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:09.084064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f435b-0f21-4d1c-8c43-f2136a6605e2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:09.122337 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:09.123655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:09.124125 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:09.124742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:09.161419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:09.168505 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fc84e-fdbd-491d-97f0-4bdd25afb399 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:09.205207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:09.208019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:09.233283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:09.233950 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:09.234390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:09.234547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] PATH_INFO: `/v3/users/d30d378fb68b4a0ba064a38337a7bc70` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:09.237680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=d30d378fb68b4a0ba064a38337a7bc70)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:09.239427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:09.245088 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 138/263] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/users/d30d378fb68b4a0ba064a38337a7bc70 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:09.256365 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:09.323393 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:09.340606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 126/264] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 00:53:09.346920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:09.414491 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:09.459281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a208a9-1250-432d-8986-ca0f6f199bbd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:09.475068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ae472-4a09-45e8-b20e-7347dcd06ae1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:09.496503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:09.497204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:09.497672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:09.497948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:09.499071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:09.500885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:09.502537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 127/265] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:09 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:09.509796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:09.564732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:09.565397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:09.565682 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:09.566236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:09.619765 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17666ca-ed7f-4251-a148-d6402e856a3f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:09.649275 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:09.656270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:09.656994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:09.658019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:09.658359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:09.659069 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=d30d378fb68b4a0ba064a38337a7bc70) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:09.659381 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:09.661100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:09.673964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 128/266] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:09 2022] GET /identity/v3/role_assignments?user.id=d30d378fb68b4a0ba064a38337a7bc70&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=b63e277927a74d40a291769119d60894 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:09.747301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:09.748843 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:09.801070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:09.898078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 139/267] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:09.903734 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:10.009304 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1f34-f335-4f7d-8c2f-98365b373e8d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:10.044152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:10.044856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.045173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.045443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.046557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:10.048070 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8065b7-0b7f-49dd-b262-9d10737c3334 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:10.050119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 129/268] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:09 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:10.056242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:10.167854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ed571-e064-4403-b3f1-2af2995d0532 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:10.215063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:10.215678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.215959 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.216231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.217016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] RBAC: Adding query filter params (role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=d30d378fb68b4a0ba064a38337a7bc70) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:10.217325 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:10.218785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e723b-a889-4778-8c2d-43a93b9e534a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:10.220778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:10.225813 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 140/269] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:10 2022] GET /identity/v3/role_assignments?user.id=d30d378fb68b4a0ba064a38337a7bc70&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:10.431501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd24c8-5449-4976-b4c4-21688c469e73 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.431877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd24c8-5449-4976-b4c4-21688c469e73 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.432050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd24c8-5449-4976-b4c4-21688c469e73 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.433703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 130/270] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:10.439366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2da78-d221-47f5-b530-542dbfde1929 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.439649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2da78-d221-47f5-b530-542dbfde1929 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.439928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2da78-d221-47f5-b530-542dbfde1929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.466317 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-18c2da78-d221-47f5-b530-542dbfde1929 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:10.467526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-18c2da78-d221-47f5-b530-542dbfde1929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:10.548396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 141/271] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:10.810177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca8f3a-7400-4d6a-a558-25b204b84052 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.810859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca8f3a-7400-4d6a-a558-25b204b84052 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.811360 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca8f3a-7400-4d6a-a558-25b204b84052 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.813173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 131/272] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:10.819345 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9361-ccde-4dd8-bec5-ee3e3cecd3f4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.819917 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9361-ccde-4dd8-bec5-ee3e3cecd3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.820403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9361-ccde-4dd8-bec5-ee3e3cecd3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.840335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-5a6d9361-ccde-4dd8-bec5-ee3e3cecd3f4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:10.841935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5a6d9361-ccde-4dd8-bec5-ee3e3cecd3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:10.917073 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 142/273] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:10.932231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca8f3a-7400-4d6a-a558-25b204b84052 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:10.991857 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4b07a-1d55-4324-8b1c-c87daed83113 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.992187 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4b07a-1d55-4324-8b1c-c87daed83113 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.992411 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4b07a-1d55-4324-8b1c-c87daed83113 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:10.994068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 143/274] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:10.999060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:10.999349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:10.999623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.001835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.017992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:11.019371 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:11.053814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca8f3a-7400-4d6a-a558-25b204b84052 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.083013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.097528 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.098353 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.098720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.099069 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.103384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 144/275] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:11.114682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:11.119639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:11.120504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:11.121344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:11.123493 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 132/276] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:11.131652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.239043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fb0-996f-4c9c-895f-2811ecd96b60 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.277671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.278645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.279109 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.279584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.280430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:11.280950 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.282560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.291784 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 145/277] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:11.297902 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.306692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.377370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.404485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a926a3-cdc5-496c-9e40-ae6d9036ef4b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.428136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.440953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a34ad-5c3f-44c5-ae37-15f739bb1a93 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.441684 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.442596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.443459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.443919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] PATH_INFO: `/v3/users/3a04e0f6885d4dedabcca66f35a7a203` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.458063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] RBAC: Authorizing `identity:get_user(user_id=3a04e0f6885d4dedabcca66f35a7a203)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.459621 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.461458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 133/278] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/users/3a04e0f6885d4dedabcca66f35a7a203 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:11.467224 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.482848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.483515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.483795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.484058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.485329 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.486836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.489408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 146/279] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:11.494831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.575602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c376be-284b-4d76-8a38-a74595d57576 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.609703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5676c9-ad21-4748-9765-24b4da6a3b8d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.618332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.618970 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.619249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.619520 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.629018 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.632579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:11.637432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:11.638319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:11.639270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 134/280] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:11.640405 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.648875 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.649511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.649790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.650062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.651162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, user.id=3a04e0f6885d4dedabcca66f35a7a203, scope.system=all) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:11.651475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.653287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e72fb-300d-41ee-bab2-e568840d581e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.658081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 147/281] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/role_assignments?user.id=3a04e0f6885d4dedabcca66f35a7a203&scope.system=all&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:11.658081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230d6f-44fc-42ea-81d5-96f25dac7ff2 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.658081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230d6f-44fc-42ea-81d5-96f25dac7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.658081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230d6f-44fc-42ea-81d5-96f25dac7ff2 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.661811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 148/282] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:11.662552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230d6f-44fc-42ea-81d5-96f25dac7ff2 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.699472 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.775530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6bee-a2b8-482d-ab5a-489d6aae6b0c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.792450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230d6f-44fc-42ea-81d5-96f25dac7ff2 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:11.818019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.818721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.819023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.819362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.820038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.821645 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d63d-52a7-46fb-9b74-714e96f8e259 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.841604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:11.842225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.843124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.843124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.843432 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:11.843742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:11.844950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 135/283] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:11 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:11.845151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:11.846102 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:11.846943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:11.846943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:11.863178 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 149/284] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:11.869188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:11.869793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:11.871345 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:11.921413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:11.964233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 136/285] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:11.989397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf934c4-6d3a-480c-b34c-fbed759237c0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.030124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.031132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.031628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.032118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] PATH_INFO: `/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.033585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] RBAC: Authorizing `identity:get_user(user_id=aa65d46b9dab4ee9a543cf73ee9510fe)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:12.035159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:12.036943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 150/286] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:11 2022] GET /identity/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:12.042346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.071415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:12.151154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db080b-a3c3-4bec-93f8-8f82dd58a052 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.190513 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.191616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.192086 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.192609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.194009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:12.195578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:12.198825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 137/287] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:12 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:12.204369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.295429 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.337792 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b10d2-719f-4959-9e0e-d6740133b216 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.361371 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:12.390964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.391633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.391911 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.392732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/aa65d46b9dab4ee9a543cf73ee9510fe/roles/0f173944247c43abb6a067350c664813` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.395813 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user_id=aa65d46b9dab4ee9a543cf73ee9510fe, role_id=0f173944247c43abb6a067350c664813)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:12.397726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:12.415049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 151/288] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:12 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/users/aa65d46b9dab4ee9a543cf73ee9510fe/roles/0f173944247c43abb6a067350c664813 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 00:53:12.417064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:12.436681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b7cd2-ffc9-4fff-8496-ea13b6625a44 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.482065 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.482630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.482907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.483171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.495592 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:12.500280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:12.501192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:12.501994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 138/289] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:12.510099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.643471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9be2ad-176f-464b-94be-f8399a43f426 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.680072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.680696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.680989 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.681324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.681993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:12.682291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:12.683720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:12.693031 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 152/290] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:12.698880 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.805431 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d6539-40cd-4268-9499-6ac8c09425be None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:12.843298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:12.843940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:12.844215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:12.844484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] PATH_INFO: `/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:12.845645 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] RBAC: Authorizing `identity:get_user(user_id=e0c8c9bf660e4907b4b2be2f3f5de445)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:12.847245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:12.848801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 139/291] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:12 2022] GET /identity/v3/users/e0c8c9bf660e4907b4b2be2f3f5de445 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:12.856049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:12.913193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:13.009653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12cd3d-f3a1-424d-bce4-d211fa490101 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:13.060418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:13.061295 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:13.061711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:13.062183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:13.148620 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:13.150342 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:13.190533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:13.286510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 153/292] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:13.292316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:13.337856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:13.439861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a752d9-42a8-408a-af81-f718e4930d84 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:13.487517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:13.488465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:13.488933 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:13.489362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:13.493854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:13.495603 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6299c9-5531-4012-9155-9053f3e704a3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:13.497545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 140/293] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:13 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:13.504079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:13.626020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db759c8-6e56-4e0d-ab15-8b456fe3e8ce None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:13.671554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:13.672407 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:13.672861 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:13.673310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:13.674176 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=e0c8c9bf660e4907b4b2be2f3f5de445) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:13.674622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:13.676344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0863b9-5313-4c8d-9aa3-ed2b4e30ccb4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:13.684941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:13.685509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 154/294] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:13 2022] GET /identity/v3/role_assignments?user.id=e0c8c9bf660e4907b4b2be2f3f5de445&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:14.529887 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114eb54-73cf-47fc-b316-2204e5e0f608 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.530442 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114eb54-73cf-47fc-b316-2204e5e0f608 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.530442 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114eb54-73cf-47fc-b316-2204e5e0f608 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.532100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 141/295] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:14.538709 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13702d-1219-4042-b57f-de9b3d16e342 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.539693 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13702d-1219-4042-b57f-de9b3d16e342 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.540168 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13702d-1219-4042-b57f-de9b3d16e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.560570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-3b13702d-1219-4042-b57f-de9b3d16e342 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:14.562163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3b13702d-1219-4042-b57f-de9b3d16e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:14.641004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 155/296] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:14.712478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9705f-4ba6-4493-b09a-fc133bc8b450 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.713154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9705f-4ba6-4493-b09a-fc133bc8b450 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.713654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9705f-4ba6-4493-b09a-fc133bc8b450 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.715538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 142/297] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:14.722808 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624534b7-dd75-4011-841f-d4134002b11e None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.723374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624534b7-dd75-4011-841f-d4134002b11e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.723867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624534b7-dd75-4011-841f-d4134002b11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.739732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8088-c2f7-463b-80e2-6373bdaba1cf None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.740340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8088-c2f7-463b-80e2-6373bdaba1cf None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.740800 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8088-c2f7-463b-80e2-6373bdaba1cf None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.742348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 143/298] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:14.744912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-624534b7-dd75-4011-841f-d4134002b11e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:14.744912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-624534b7-dd75-4011-841f-d4134002b11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:14.747829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8250d7-c32f-4797-a652-266fafe2ff87 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:14.748166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8250d7-c32f-4797-a652-266fafe2ff87 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:14.748649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8250d7-c32f-4797-a652-266fafe2ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:14.767292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-aa8250d7-c32f-4797-a652-266fafe2ff87 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:14.769076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-aa8250d7-c32f-4797-a652-266fafe2ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:14.817263 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 156/299] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:14.845247 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 144/300] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:14.978904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624534b7-dd75-4011-841f-d4134002b11e None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.022125 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601d68-163e-4718-88b1-e2c2e162deb4 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.022742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601d68-163e-4718-88b1-e2c2e162deb4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.023228 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601d68-163e-4718-88b1-e2c2e162deb4 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.025021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 145/301] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:15.030078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.030738 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.031203 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.039425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.052112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:15.053539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:15.073302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.091813 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624534b7-dd75-4011-841f-d4134002b11e None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.131080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 146/302] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:15.138910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.139773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.140249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.140686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.151420 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:15.153128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:15.157475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:15.158367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:15.159177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 157/303] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:15.166324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.267867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550902-e35e-4f47-ae6f-f432d916ad0a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.271356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bad64d-dced-4059-9a58-79fe9605e456 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.286204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.304960 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.305568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.305842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.305936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.306106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.306673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.306827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:15.307066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.307153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.307419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.308557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.321905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 158/304] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:15.321905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.323084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:15.327907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:15.328819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 147/305] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:15.334301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.347811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.426694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f68df-b09a-455f-8b47-f119c66b3235 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.442175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580e26-6075-4f88-9687-d5095889e444 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.462816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.463476 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.463780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.464076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.465239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.466722 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.468290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 159/306] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:15.469201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.477994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.478626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.478900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.479170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] PATH_INFO: `/v3/users/3a04e0f6885d4dedabcca66f35a7a203` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.480280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] RBAC: Authorizing `identity:get_user(user_id=3a04e0f6885d4dedabcca66f35a7a203)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.481753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.483313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 148/307] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/users/3a04e0f6885d4dedabcca66f35a7a203 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:15.484067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.521431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.557964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.574668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083fa33-df0f-4809-918d-6c26311d9693 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.579801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6dcd0-e686-43c7-bab9-94e063862416 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.608953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.609580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.609859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.610131 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.610871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:15.611092 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.612445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.613344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.613969 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.614245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.614508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.620655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 160/308] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:15.621293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.628955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:15.633683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:15.634560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:15.635373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 149/309] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:15.636033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.723201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24696-09b7-419c-b2f4-90e8f91fdb7a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.733177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5502eb-23c1-4957-8de7-4c9e6286ae28 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.733660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.758365 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.758976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.759259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.759536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] PATH_INFO: `/v3/groups` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.760160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.761658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.765906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.766550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.766829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.767106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] PATH_INFO: `/v3/system/users/3a04e0f6885d4dedabcca66f35a7a203/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.768542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a04e0f6885d4dedabcca66f35a7a203, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.770296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.777497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 161/310] 10.222.0.78 () {60 vars in 1134 bytes} [Fri Aug 19 00:53:15 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:15.778418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.779307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 150/311] 10.222.0.78 () {58 vars in 1334 bytes} [Fri Aug 19 00:53:15 2022] PUT /identity/v3/system/users/3a04e0f6885d4dedabcca66f35a7a203/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:15.780321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.789547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:15.917752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e8ea4-de81-4ca3-93ae-1ddec946dda7 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.922688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9b4df-f047-4119-b831-093c8b5e037a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:15.957685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.958476 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.958829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.959177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] PATH_INFO: `/v3/users/faee534e7cb849bdaacbd0c165646639` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.966403 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:15.967389 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:15.967878 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:15.968314 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:15.969212 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:15.969717 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.971317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.975885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=faee534e7cb849bdaacbd0c165646639)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:15.977544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:15.979656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 162/312] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/users/faee534e7cb849bdaacbd0c165646639 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:15.981523 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 151/313] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:15.987157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:15.987748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:16.022338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:16.069499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:16.112419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533a9b8-00c7-480b-a017-8ca991ae86c2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:16.125667 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce228ec-124c-44a8-a157-bcb18a7ec6f4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:16.151909 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:16.152972 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:16.153252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:16.153522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] PATH_INFO: `/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:16.155143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] RBAC: Authorizing `identity:get_user(user_id=aa65d46b9dab4ee9a543cf73ee9510fe)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:16.156596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:16.159079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 152/314] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/users/aa65d46b9dab4ee9a543cf73ee9510fe => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:16.165009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:16.177638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:16.178337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:16.178712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:16.179576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:16.180852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, user.id=faee534e7cb849bdaacbd0c165646639, scope.system=all) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:16.181297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:16.183392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:16.190928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 163/315] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Aug 19 00:53:15 2022] GET /identity/v3/role_assignments?user.id=faee534e7cb849bdaacbd0c165646639&scope.system=all&role.id=0f173944247c43abb6a067350c664813 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:16.284698 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668d44-53b5-4cb4-a8cb-7d70b58ae565 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:16.322165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:16.329492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:16.331913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:16.331913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:16.331913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:16.419625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:16.421110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:16.522510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 153/316] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:16.528120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:16.621467 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:16.631568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b021-df2d-4282-81cf-4ac140ab325c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:16.670661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:16.671296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:16.671570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:16.671835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:16.672975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:16.674416 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5367a-d818-4980-9f96-a1c672d0930d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:16.676683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 164/317] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:16 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:16.682216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:16.715221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:16.794643 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0dcd-a6fb-435b-a1a3-1962c498793a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:16.829359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:16.829965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:16.830246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:16.830522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:16.831350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36, user.id=aa65d46b9dab4ee9a543cf73ee9510fe) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:16.831749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:16.833549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c95d7-88dd-4ebb-b0cc-3b7deeb71baf None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:16.839760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 154/318] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:16 2022] GET /identity/v3/role_assignments?user.id=aa65d46b9dab4ee9a543cf73ee9510fe&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=0f173944247c43abb6a067350c664813 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:18.063025 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da27b-7538-48ae-9d24-2ea195663b9e None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.063558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da27b-7538-48ae-9d24-2ea195663b9e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.063558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da27b-7538-48ae-9d24-2ea195663b9e None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.064860 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 165/319] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:18.070320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28448b-b682-4452-9411-251cd0193d11 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.070447 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09fd2-fa89-49b3-977e-0d2b3a6b39a4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.070818 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09fd2-fa89-49b3-977e-0d2b3a6b39a4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.070910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28448b-b682-4452-9411-251cd0193d11 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.070910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28448b-b682-4452-9411-251cd0193d11 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.071045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d09fd2-fa89-49b3-977e-0d2b3a6b39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.072123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 166/320] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:18.077008 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d61cd-c984-47c1-9161-42c2294e0c09 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.077338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d61cd-c984-47c1-9161-42c2294e0c09 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.077698 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d61cd-c984-47c1-9161-42c2294e0c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.090154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-34d09fd2-fa89-49b3-977e-0d2b3a6b39a4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:18.091733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-34d09fd2-fa89-49b3-977e-0d2b3a6b39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:18.096511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-369d61cd-c984-47c1-9161-42c2294e0c09 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:18.097893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-369d61cd-c984-47c1-9161-42c2294e0c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:18.157255 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 155/321] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:18.172279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 167/322] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:18.462018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a01a-17ab-43e4-b976-cd2fa70fd249 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.462199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a01a-17ab-43e4-b976-cd2fa70fd249 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.462417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a01a-17ab-43e4-b976-cd2fa70fd249 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.463904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 156/323] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:18.469264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.469532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.469835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.481359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a01a-17ab-43e4-b976-cd2fa70fd249 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:18.488748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:18.489977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:18.511253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:18.555567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 168/324] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:18.556404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:18.577332 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:18.591803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a01a-17ab-43e4-b976-cd2fa70fd249 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:18.631169 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:18.631808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.632091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.632358 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.633471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:18.635066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:18.636939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 157/325] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:18.641858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:18.661901 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0679b-050a-4f1f-830b-847e741e3bfc None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:18.697608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305403a5-2432-4f89-8889-6414738d836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:18.698137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305403a5-2432-4f89-8889-6414738d836e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.698415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305403a5-2432-4f89-8889-6414738d836e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.698824 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305403a5-2432-4f89-8889-6414738d836e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.708881 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305403a5-2432-4f89-8889-6414738d836e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-305403a5-2432-4f89-8889-6414738d836e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:18.713633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:18.714515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:18.715337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 169/326] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:18.722019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305403a5-2432-4f89-8889-6414738d836e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:18.736230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:18.743830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aca758-321a-4acc-8caf-a46de7e19ec8 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:18.779397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:18.779996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.780267 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.780530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] PATH_INFO: `/v3/groups` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.781181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:18.782600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:18.803544 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 158/327] 10.222.0.78 () {60 vars in 1134 bytes} [Fri Aug 19 00:53:18 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:53:18.809830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:18.834230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305403a5-2432-4f89-8889-6414738d836e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:18.877565 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:18.878246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:18.878524 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:18.878791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:18.879473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:18.879775 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:18.881257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:18.884570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:18.890885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 170/328] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:18.896940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:19.009703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb9a4-6648-4c10-b5e8-1468c86095f7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.011723 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d336e-1cb3-4153-ba1c-f104ad057626 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.049213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.050412 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.051013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.051289 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.054670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.055316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.055599 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.055870 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] PATH_INFO: `/v3/users/3a04e0f6885d4dedabcca66f35a7a203` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.057474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] RBAC: Authorizing `identity:get_user(user_id=3a04e0f6885d4dedabcca66f35a7a203)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:19.058922 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:19.061001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 171/329] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:18 2022] GET /identity/v3/users/3a04e0f6885d4dedabcca66f35a7a203 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:19.064976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:19.066866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:19.071471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:19.072803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:19.076008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 159/330] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:19.077327 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:19.080817 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:19.103465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:19.191750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48611f5-13be-41a0-9850-a9dc4a491654 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.215189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540370-c43d-4b52-9f0b-6f999eacf07d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.233781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.234929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.235804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.236884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.238941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] RBAC: Adding query filter params (role.id=a8b781dc46fb43c9aaaac21dba171b3c, user.id=3a04e0f6885d4dedabcca66f35a7a203, scope.system=all) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:19.240090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:19.243710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:19.264713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 172/331] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Aug 19 00:53:19 2022] GET /identity/v3/role_assignments?user.id=3a04e0f6885d4dedabcca66f35a7a203&scope.system=all&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:19.280006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.280326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.280503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.280774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.281527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:19.281830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:19.283241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:19.295092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 160/332] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:19.300758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:19.378336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:19.415983 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671905-ea25-4384-b5d6-b2b52d62f55e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.454059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.454991 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.455268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] PATH_INFO: `/v3/users/faee534e7cb849bdaacbd0c165646639` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.456517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] RBAC: Authorizing `identity:get_user(user_id=faee534e7cb849bdaacbd0c165646639)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:19.458036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40839d08-e5cb-4fb0-a126-3d6a73598b8a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:19.460029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 173/333] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:19 2022] GET /identity/v3/users/faee534e7cb849bdaacbd0c165646639 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:19.465464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:19.558400 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:19.586590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295ae7a-8120-4c55-9179-a207db22d98e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:19.630003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:19.630752 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:19.631092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:19.631434 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] PATH_INFO: `/v3/system/users/faee534e7cb849bdaacbd0c165646639/roles/0f173944247c43abb6a067350c664813` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:19.633033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=faee534e7cb849bdaacbd0c165646639, role_id=0f173944247c43abb6a067350c664813)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:19.634480 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223233ff-7861-41bd-87ce-f75e33c2a909 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:19.644693 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 161/334] 10.222.0.78 () {58 vars in 1334 bytes} [Fri Aug 19 00:53:19 2022] PUT /identity/v3/system/users/faee534e7cb849bdaacbd0c165646639/roles/0f173944247c43abb6a067350c664813 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:22.083539 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc2bd-351d-454f-86da-1c992d121c20 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.084118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc2bd-351d-454f-86da-1c992d121c20 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.084118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bc2bd-351d-454f-86da-1c992d121c20 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.085438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 174/335] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:22.091039 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d264cfb-4c66-4543-a58b-2ba4bc54b8af None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.091604 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d264cfb-4c66-4543-a58b-2ba4bc54b8af None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.091686 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d264cfb-4c66-4543-a58b-2ba4bc54b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.115637 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0d264cfb-4c66-4543-a58b-2ba4bc54b8af None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:22.116835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0d264cfb-4c66-4543-a58b-2ba4bc54b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:22.200350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 162/336] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:22.248191 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8946e-79c6-473a-9b1c-f79b5b5a47b0 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.248506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8946e-79c6-473a-9b1c-f79b5b5a47b0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.248740 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8946e-79c6-473a-9b1c-f79b5b5a47b0 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.251949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 175/337] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:22.259204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c88a-3893-43b5-a228-f017fce6b1d4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.259491 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c88a-3893-43b5-a228-f017fce6b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.259768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c88a-3893-43b5-a228-f017fce6b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.287822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5922c88a-3893-43b5-a228-f017fce6b1d4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:22.289022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5922c88a-3893-43b5-a228-f017fce6b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:22.370436 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:22.375205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 163/338] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:22.404203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ceeed-c419-4976-a1b7-8716872ebe49 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.404548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ceeed-c419-4976-a1b7-8716872ebe49 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.404760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ceeed-c419-4976-a1b7-8716872ebe49 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.406430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 176/339] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:22.413446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dd54e-54f1-4b61-9e17-d96aa74253c0 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.413774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dd54e-54f1-4b61-9e17-d96aa74253c0 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.413986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dd54e-54f1-4b61-9e17-d96aa74253c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.442144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-bd6dd54e-54f1-4b61-9e17-d96aa74253c0 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:22.443368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-bd6dd54e-54f1-4b61-9e17-d96aa74253c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:22.516989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 164/340] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:22.759046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f52f2-944b-42b1-acf0-bcf3da8b8a58 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.759234 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f52f2-944b-42b1-acf0-bcf3da8b8a58 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.759502 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f52f2-944b-42b1-acf0-bcf3da8b8a58 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.761118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 177/341] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:22.766481 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.766766 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.767037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.797074 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:22.798330 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:22.804549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caa3-94df-4c23-bbb0-2d93308caba6 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.804830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caa3-94df-4c23-bbb0-2d93308caba6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.805138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8caa3-94df-4c23-bbb0-2d93308caba6 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.806759 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 178/342] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:22.814151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:22.814430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:22.814704 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:22.844473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:22.845683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:22.910249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 165/343] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:22.911357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:22.956112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 179/344] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:22.957218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:22.981400 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.038247 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.067114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aa678-633a-46ac-9713-bfd2fe51f22e None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.076348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4cd0a-3a3c-4ce9-baf5-0e8fb0c825ed None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.115277 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.116025 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.116289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.116558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.121750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.122406 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.122652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.122923 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.133635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:23.137419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:23.138545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:23.139421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:23.140264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 180/345] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:23.140988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:23.146099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:23.147009 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 166/346] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:23.148425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.303229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19281ef-2c41-47c4-930b-3b76f4773843 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.332881 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1a3f-0d74-46ba-829e-0f8273f6e9a6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.341185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.359508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.360469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.361851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.362418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.363388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:23.363691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:23.365120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:23.374392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 167/347] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:23.375474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.378251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.387654 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.388649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.389217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.389747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.403959 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:23.409949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:23.411348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:23.412186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:23.415039 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 181/348] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:23.417724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.488850 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076979e-b360-4ba8-9511-ec9f77a66493 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.538960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.538960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.538960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.539320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.540084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:23.540383 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:23.542247 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:23.546474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b143-5c39-4d7f-a0f6-046eed2781d4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.555237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 168/349] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:23.557169 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.588507 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.589571 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.590187 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.591492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.605028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:23.610844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:23.611735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 182/350] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:23.612981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.626567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.669695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.697803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d7467-a807-460f-852b-4c32aa1edad5 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.739432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.739665 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383e8d4-95fa-4ae9-9923-8cad96baa3d9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.740516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.741032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.741368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.779654 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.780303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.780628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.780845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.796535 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:23.801789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:23.802702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:23.803516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 183/351] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:23.804178 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.824309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:23.825836 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:23.882819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.927048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a7a19-ecaf-4e2e-b309-17164451b4de None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:23.940342 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:23.965357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 169/352] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:23.969017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:23.977410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:23.978041 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:23.978316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:23.978584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:23.979264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:23.979564 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:23.981049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:23.990739 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 184/353] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:23.995874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.099203 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb102-82c9-411b-bba4-50ac57fb8939 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.127003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e14ca-7d31-4207-bd9a-ace9dbaaf93b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.151150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.152034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.152311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.152576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.165677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.167077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.167605 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.168037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.168803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.169209 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:24.169577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.172258 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.182481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 185/354] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:24.183157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.223685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.235543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.238498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.319629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eca14-ce9a-4b14-8485-d674f81bf912 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.363126 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 170/355] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:24.363995 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.364102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.364687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.364984 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.368945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.368945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:24.368945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.368945 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.378888 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 186/356] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:24.379849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.420648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.492371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edd1f-18fc-44ba-aef6-bd859a8872bd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.510324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.523880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5fb33-318b-4d62-9089-63a70019bc0a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.534390 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.535007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.535280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.535546 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.537546 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.539000 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee8fcd-24ce-4447-b1d9-da6d177e9965 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.540633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 171/357] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:24.542006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2992-d80c-4149-94b1-8ac1bcd5a32a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.542265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2992-d80c-4149-94b1-8ac1bcd5a32a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.542535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2992-d80c-4149-94b1-8ac1bcd5a32a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.544019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 172/358] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:24.544640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2992-d80c-4149-94b1-8ac1bcd5a32a None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.567054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.567675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.568414 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.568414 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.653758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.655274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.667447 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa2992-d80c-4149-94b1-8ac1bcd5a32a None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.684535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.713018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.714206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.714206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.714370 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] PATH_INFO: `/v3/users/faee534e7cb849bdaacbd0c165646639` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.716326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] RBAC: Authorizing `identity:get_user(user_id=faee534e7cb849bdaacbd0c165646639)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.717842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.718806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 173/359] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/users/faee534e7cb849bdaacbd0c165646639 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:24.719563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.764549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.774441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 187/360] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:24.774441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.840260 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4ec0c-16e9-49f8-9380-b0cba65ff457 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.883735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.884388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.884669 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.884968 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.886210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:24.887665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:24.889486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 174/361] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:24.890183 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:24.894443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215ba7f-0cce-46a2-a4e0-a309536a9d91 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:24.938292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:24.938836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:24.939113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:24.939383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:24.953250 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:24.998383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.004672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a3900-981c-43f2-9df7-7efc0c621b9b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.009307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.010814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.038695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.039327 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.039585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.039842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.045521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.047082 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df34eb-7bdd-48af-a594-910eb3c54a87 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.048805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 175/362] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.049857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.050146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.050415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.068094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:25.069296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:25.116095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 188/363] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:25.117106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.135465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 176/364] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:25.136290 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.181208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.219859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.231122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dca50-c30b-48c8-86bb-9969bb5dc82e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.238158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21d68-6556-4ede-9567-2602f984c08f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.274280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.274972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.275431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.275695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.276479 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] RBAC: Adding query filter params (role.id=0f173944247c43abb6a067350c664813, user.id=faee534e7cb849bdaacbd0c165646639, scope.system=all) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:25.276787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.277919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.278279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.278547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.278819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.279083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.280160 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.281615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.283236 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 177/365] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.288136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.304935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 189/366] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/role_assignments?user.id=faee534e7cb849bdaacbd0c165646639&scope.system=all&role.id=0f173944247c43abb6a067350c664813 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.304935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.423245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30708c4-7073-4fc5-8142-b0883291817d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.432595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4cbd2-f745-4a14-9345-12bb6c0467da None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.439596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.472172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.472760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.473141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.473264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.473425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.474010 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.474353 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.474573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.474703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.475553 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:25.475916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.476013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.477491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.482893 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 178/367] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.493045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.493250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 190/368] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.493250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.513513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.625702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116482e-1d7a-4117-99ba-d28b2ca916f0 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.629445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fbd0-c1e6-4fdf-8d68-a5009afa23df None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.670292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.671379 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.671866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.672350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.673934 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.675836 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.676868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.677551 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.677832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.678106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.678814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 179/369] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.679260 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.680062 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.680803 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.682427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 191/370] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.683213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.738964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.797178 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:25.809585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa365b2-59c4-4ec9-a44a-1a8763b3252a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.824394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925673-a246-4c17-b50b-30bed0080970 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:25.855100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.855989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.856407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.856841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.869880 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:25.871610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:25.872225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:25.872504 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:25.872776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:25.873539 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=60382a301fa147febfb309284f9b660c) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:25.873848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:25.874759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:25.875640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:25.876430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:25.878123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:25.878198 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 180/371] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:25.878198 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:25.885094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 192/372] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:25.885927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:26.007182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa540e2-0df0-4a2a-84e0-adb97c42ee7b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.017150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844043-2895-4c96-a717-2807f0075503 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.026044 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:26.057680 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.058324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.058593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.058863 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.060322 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.061247 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.061776 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.062324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.062795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.063259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.064187 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=60382a301fa147febfb309284f9b660c) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:26.064695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.067897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.068428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 181/373] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:26.069363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:26.080172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 193/374] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:25 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:26.081355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:26.097235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:26.205756 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aa1b-82f4-42a1-b292-775279105634 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.206847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e335b5-4cd0-4ae6-8958-567c9c79107b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.260248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.262529 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.263678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.264254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.266459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:26.267744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.270208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.278216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.279112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.279526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.279963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.280797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:26.281258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.282813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.286478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 194/375] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:26 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:26.295732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 182/376] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:26.303250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:26.423597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:26.452151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cad21-f587-4a50-9ff4-5e391898c828 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.488344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.489015 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.489301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.489576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.578639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.580111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.670102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:26.703158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 195/377] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:26.708567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:26.767872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:26.837723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb226a6-783c-4019-86ea-d1a88b1ff1cc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:26.881627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:26.882271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:26.882552 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:26.882827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] PATH_INFO: `/v3/projects/560e1cc0afb64bafa1e6557ba86b9432` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:26.883987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] RBAC: Authorizing `identity:get_project(project_id=560e1cc0afb64bafa1e6557ba86b9432)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:26.885472 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:26.887093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 183/378] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:26 2022] GET /identity/v3/projects/560e1cc0afb64bafa1e6557ba86b9432 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:26.892845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:27.026092 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c883fd-9c80-4efb-9778-2ef83320c765 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:27.075136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:27.075776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:27.076068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:27.076386 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] PATH_INFO: `/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:27.087011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] RBAC: Authorizing `identity:get_group(group_id=26a08a78a74f4ff4a93f9619a8f8b73c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:27.088512 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac937d-94eb-4f70-b00f-7c51e577bb39 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:27.090344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 196/379] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:26 2022] GET /identity/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:27.096211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:27.241192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6d9f1-605f-4635-a9b0-bd07ecf2f850 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:27.246090 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:27.289420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:27.290028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:27.290320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:27.290653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:27.291373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] RBAC: Adding query filter params (group.id=26a08a78a74f4ff4a93f9619a8f8b73c, role.id=b63e277927a74d40a291769119d60894, scope.project.id=560e1cc0afb64bafa1e6557ba86b9432) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:27.291673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:27.293195 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78cb15-3fe3-4523-b219-cff648b973ec None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:27.299292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 184/380] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:27 2022] GET /identity/v3/role_assignments?group.id=26a08a78a74f4ff4a93f9619a8f8b73c&scope.project.id=560e1cc0afb64bafa1e6557ba86b9432&role.id=b63e277927a74d40a291769119d60894 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:28.233719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27f6c-0c62-461d-b21f-493d392e08d2 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.234245 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27f6c-0c62-461d-b21f-493d392e08d2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.234245 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27f6c-0c62-461d-b21f-493d392e08d2 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.235598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 197/381] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:28.251347 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced20d-6e41-4f4f-922d-8ee3cc80c4b4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.251857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced20d-6e41-4f4f-922d-8ee3cc80c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.251945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced20d-6e41-4f4f-922d-8ee3cc80c4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.282356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5eced20d-6e41-4f4f-922d-8ee3cc80c4b4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:28.283609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5eced20d-6e41-4f4f-922d-8ee3cc80c4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:28.372112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 185/382] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:28.713592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee59ca-9990-4c14-93a8-92e0dad2bf23 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.714277 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee59ca-9990-4c14-93a8-92e0dad2bf23 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.714745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee59ca-9990-4c14-93a8-92e0dad2bf23 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.716549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 198/383] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:28.722097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.722392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.722671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.746541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:28.747726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:28.767977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd883-1373-4932-bce6-68fe5241b6a8 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.768660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd883-1373-4932-bce6-68fe5241b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.769155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccd883-1373-4932-bce6-68fe5241b6a8 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.771946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 199/384] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:28.776174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375e55-3041-4b05-b8a5-bd04f518ff79 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:28.776692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375e55-3041-4b05-b8a5-bd04f518ff79 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:28.777203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375e55-3041-4b05-b8a5-bd04f518ff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:28.812229 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-40375e55-3041-4b05-b8a5-bd04f518ff79 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:28.813836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-40375e55-3041-4b05-b8a5-bd04f518ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:28.863350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 186/385] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:28.863737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:28.928777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 200/386] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:28.986114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.017349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa67b-bdd0-4922-bfc2-98fb8533ce9d None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.017733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa67b-bdd0-4922-bfc2-98fb8533ce9d None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.018203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafa67b-bdd0-4922-bfc2-98fb8533ce9d None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.019677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 201/387] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:29.041165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.041517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.041758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.050396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.086264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:29.087147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:29.142010 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734a65d-0597-46ce-a4ce-d2d49dfd067d None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.176833 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.177817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.178296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.178796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.189443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:29.194395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:29.195281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:29.196080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:29.198812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 187/388] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:29.199977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 202/389] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:29.205815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.287629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.337242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.346928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e31f-5e99-424d-84d7-e5f1ca6fbc46 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.392564 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.393875 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.395421 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.395897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.396745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:29.397396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:29.399041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:29.412291 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 188/390] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:29.413426 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.428405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.432467 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c9475-1816-4ab1-946d-2a6dd53e24b9 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.470147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.471048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.471532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.471952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.483362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:29.488930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:29.489993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:29.490862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:29.497839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 203/391] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:29.498985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.546028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e58f-2799-4775-b214-cd735d0592f0 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.590050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.591181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.591596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.592021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.606098 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:29.611946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e14ab-27f4-4f86-aace-1de983f2ed55 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:29.612883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:29.613829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:29.614633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:29.615318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 189/392] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:29.616225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.630048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.647279 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.647906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.648179 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.648448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.649665 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:29.651183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:29.652727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 204/393] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:29.657944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.686782 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.723950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf5ff5-8e23-4204-84ed-23c8f4225a6f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.758949 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.759557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.759834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.760100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.760867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:29.761294 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:29.762656 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:29.764045 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069767a2-193b-4864-82c0-6c2146fcc66e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.775764 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 190/394] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:29.775764 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.804473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.805069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.805344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.805616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.816044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:29.820679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:29.821590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:29.822384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 205/395] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:29.823705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.848877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.880578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c8fa-ea8f-444f-9bb4-7eff0c88ac72 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.914840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.915447 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.915725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.915998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.916653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:29.916982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:29.918151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:29.918340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:29.927941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 191/396] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:29.929202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:29.939373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f4b1-f15c-447b-a59d-bc7f78f2dfcc None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:29.980064 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:29.981028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:29.981476 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:29.981803 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:29.983083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:29.984637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:29.986613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 206/397] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:29.987617 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.039108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c41b-6557-4991-aa66-d1fe0e7f5b50 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.077658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.078200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.078475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.078742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.079846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.081486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.083059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 192/398] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.083956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.086796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.098764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099969e4-6fde-4909-b001-fb442b5dfcb1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.134159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.134765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.135040 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.135308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.135968 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:30.136265 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.137659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.145724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 207/399] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.146473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.164245 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.189456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced18fa-b25e-4dcb-8895-1ac74b21e25d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.222672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.223291 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.223562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.223828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.225012 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.226435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.227972 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 193/400] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:30 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.232756 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.247462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ec5a-d9a1-4829-b0c8-65052032c890 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.284458 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.285174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.285455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.285729 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/04c91b52415947b7ae240c2d7a82ecbd` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.288202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, group_id=b9df747bf5dc481e91ea0208b698b3c8, role_id=04c91b52415947b7ae240c2d7a82ecbd)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.289764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595d3bf-eb47-4e18-9f83-9bb27c07a594 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.299102 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.302518 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 208/401] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Aug 19 00:53:30 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/04c91b52415947b7ae240c2d7a82ecbd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:30.303705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ef77-8a47-4469-a921-118aff654d98 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.304016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ef77-8a47-4469-a921-118aff654d98 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.304292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ef77-8a47-4469-a921-118aff654d98 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.309653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 209/402] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:30.309653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ef77-8a47-4469-a921-118aff654d98 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.341798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0df0-18e0-4e31-9a88-71f8db90d597 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.381432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.382377 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.382924 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.383214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.384535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.386087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.393793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 194/403] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:30 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.394930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.419569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.452933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ef77-8a47-4469-a921-118aff654d98 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.491750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.492403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.492686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.493011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.494152 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.495598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491012b2-4900-4dbd-8110-fbef0129804c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.497587 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 210/404] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:30 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.498404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.498737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.499000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.516109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc89a49-6928-4d39-83d5-1241952bc676 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.520818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:30.522052 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:30.550166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.550796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.551079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.551386 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.552521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.554031 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.560811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 195/405] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:30 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.560811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.571343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.600419 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 211/406] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:30.601329 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.682098 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c3f7-e6d7-49d5-a427-373396346e88 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.703026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.728147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.729487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.730195 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.730696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/04c91b52415947b7ae240c2d7a82ecbd` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.733881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, group_id=b9df747bf5dc481e91ea0208b698b3c8, role_id=04c91b52415947b7ae240c2d7a82ecbd)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.734892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659eaf1-3f20-4117-b6ba-e27a8c7e9a2b None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.735748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.753599 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 196/407] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Aug 19 00:53:30 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/04c91b52415947b7ae240c2d7a82ecbd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:30.754896 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.797750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.798452 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.798734 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.799308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.800464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.810103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:30.812151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 212/408] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:30 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:30.818807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:30.857473 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:30.930089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7536f-9cb9-4b6c-ad78-be155f7138ee None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.968165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975c984-be2e-4089-9f58-ba3ba7f8670c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:30.984484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:30.987005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:30.987005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:30.987005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:30.990913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] RBAC: Authorizing `identity:create_grant(project_id=60382a301fa147febfb309284f9b660c, group_id=b9df747bf5dc481e91ea0208b698b3c8, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:30.991028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:31.010511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 197/409] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Aug 19 00:53:30 2022] PUT /identity/v3/projects/60382a301fa147febfb309284f9b660c/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:31.011409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:31.021769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.022473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.022761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.023037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.026367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36, group_id=b9df747bf5dc481e91ea0208b698b3c8, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:31.027885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:31.052596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 213/410] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Aug 19 00:53:30 2022] PUT /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36/groups/b9df747bf5dc481e91ea0208b698b3c8/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:31.135449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225705c-9e4f-4b7a-acb0-b394612d759a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:31.165984 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:31.176952 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.177774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.178423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.178705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.191881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:31.197498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:31.198435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:31.199525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 198/411] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:31.205203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:31.211324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:31.372824 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa2e9-3d39-44e5-89a4-05a3468db7f7 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:31.408848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.409618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.409899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.410170 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.410844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:31.411142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:31.412544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:31.423361 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 214/412] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:31.429431 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:31.553007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c631f9-3ff4-4c8d-bbc0-fca6db43e48e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:31.593597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.594521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.594963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.595395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] PATH_INFO: `/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.596789 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] RBAC: Authorizing `identity:get_group(group_id=26a08a78a74f4ff4a93f9619a8f8b73c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:31.598416 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:31.600487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 199/413] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:31 2022] GET /identity/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:31.605871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:31.683993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:31.730308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d93ed-36c3-49e5-a205-751f97035542 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:31.766289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.767220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.767764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.768203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] PATH_INFO: `/v3/projects/560e1cc0afb64bafa1e6557ba86b9432` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.769610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] RBAC: Authorizing `identity:get_project(project_id=560e1cc0afb64bafa1e6557ba86b9432)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:31.771204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbe0d-bb54-4fc9-a9b2-c9208b3982d1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:31.773331 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 215/414] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:31 2022] GET /identity/v3/projects/560e1cc0afb64bafa1e6557ba86b9432 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:31.782076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:31.874037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:31.938787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317b7c-68df-40f0-8133-6ebbeb038f66 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:31.986673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:31.987433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:31.987708 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:31.987979 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] PATH_INFO: `/v3/projects/560e1cc0afb64bafa1e6557ba86b9432/groups/26a08a78a74f4ff4a93f9619a8f8b73c/roles/b63e277927a74d40a291769119d60894` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:31.994170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] RBAC: Authorizing `identity:create_grant(project_id=560e1cc0afb64bafa1e6557ba86b9432, group_id=26a08a78a74f4ff4a93f9619a8f8b73c, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:31.995608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696b764-8105-4588-b6b3-8f877cf2665e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:32.012046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 200/415] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Aug 19 00:53:31 2022] PUT /identity/v3/projects/560e1cc0afb64bafa1e6557ba86b9432/groups/26a08a78a74f4ff4a93f9619a8f8b73c/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:33.029661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9ec3-6982-4fc3-b0cb-5fefe87a9379 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.030679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9ec3-6982-4fc3-b0cb-5fefe87a9379 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.031165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9ec3-6982-4fc3-b0cb-5fefe87a9379 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.032751 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 216/416] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:33.038672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd5ba-bc43-4f42-b62d-cb833e81404b None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.039094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd5ba-bc43-4f42-b62d-cb833e81404b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.039290 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd5ba-bc43-4f42-b62d-cb833e81404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.066029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-7bbdd5ba-bc43-4f42-b62d-cb833e81404b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:33.067244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-7bbdd5ba-bc43-4f42-b62d-cb833e81404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:33.155487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 201/417] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:33.416055 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ebfeb-eb71-453d-bb98-2fbe288e2399 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.416246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ebfeb-eb71-453d-bb98-2fbe288e2399 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.416526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ebfeb-eb71-453d-bb98-2fbe288e2399 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.418364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 217/418] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:33.423667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c39e-3c47-4985-8327-654cf1efe7c2 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.424057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c39e-3c47-4985-8327-654cf1efe7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.424328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c39e-3c47-4985-8327-654cf1efe7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.449437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-aca8c39e-3c47-4985-8327-654cf1efe7c2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:33.450609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-aca8c39e-3c47-4985-8327-654cf1efe7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:33.509211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:33.544042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 202/419] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:33.575626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ebfeb-eb71-453d-bb98-2fbe288e2399 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:33.686157 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a811-bc92-44c1-89de-83eadc623d8d None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.686451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a811-bc92-44c1-89de-83eadc623d8d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.686625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a811-bc92-44c1-89de-83eadc623d8d None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.688196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 203/420] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:33.694006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.694284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.694561 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.706558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ebfeb-eb71-453d-bb98-2fbe288e2399 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:33.733132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:33.734324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:33.742812 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:33.745464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:33.746106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:33.746383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:33.746659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:33.770490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:33.776547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:33.777471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:33.778292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:33.785164 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 218/421] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:33.792941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:33.897016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 204/422] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:33.897947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:33.944155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957be27-04d6-4296-960b-8af014bd8a01 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.004021 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.004629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.004917 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.005188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.005849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:34.006149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.008987 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca50f-b581-4e6a-87b5-1b490f311350 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.023310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 219/423] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:34.024657 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c722-274a-474b-a49c-6275df3fc9ca None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.024971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c722-274a-474b-a49c-6275df3fc9ca None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.025244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c722-274a-474b-a49c-6275df3fc9ca None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.026788 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 220/424] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:34.028483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9c722-274a-474b-a49c-6275df3fc9ca None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.057563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602b7f-bec1-4893-924a-a9fc4e42fce9 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.061733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.095064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.095793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.096231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.096504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.099647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.108742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1271fd22-b8c0-4dc9-9728-cc54a95550c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:34.113795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:34.114697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 00:53:34.115554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:34.119811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 205/425] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:34.121167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.121606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.121885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.140354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:34.141677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:34.156838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9c722-274a-474b-a49c-6275df3fc9ca None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.201076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.201615 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.201899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.202177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.233427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 206/426] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:34.233931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.301651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.303142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.337107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.344824 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723cf1b-7c03-49df-a29e-375d706849ee None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.376926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.381601 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.382294 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.382641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.382982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.383717 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:34.384084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.385587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.394391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 207/427] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:34.395313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.435990 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 221/428] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:34.436971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.512221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80e32-abd9-452a-a7d7-0206d643ae45 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.547311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.548059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.548397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.548764 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.562111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:34.567925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:34.569048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:34.570034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:34.570682 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5f2-fd11-481e-8a6d-64ad7a3c980f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.575884 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 208/429] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:34.576701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.597107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.606413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.607220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.607569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.607907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.633298 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.679802 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.681581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.682029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8113f-0f73-44ea-a682-1a28381fcf84 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.715054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.715677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.715959 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.716234 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.717395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.718922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.725139 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 209/430] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:34.725139 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.788970 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 222/431] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:34.790218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.823423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.848066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656647-51c1-49e8-a141-d5d3a31f328c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.853555 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:34.895777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.896467 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.896747 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.897048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.897708 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:34.898005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:34.899363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:34.912720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 210/432] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:34.912720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:34.912996 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa155c4-5f64-4e87-bd5b-9ac0585cdd60 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:34.948761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:34.949446 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:34.949724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:34.949998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:34.960367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:34.965128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:34.966009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 223/433] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:34.969624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.023189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11ea78-b1d5-4c12-8a21-87aebd94f9d1 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.055089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.055631 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.055900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.056165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.057273 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.059008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.060704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 211/434] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.061323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.070874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ffe16-ad5e-413f-bbee-5aa50f0f9b2d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.077557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.085681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.105779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.106430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.106733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.107007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.108161 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.109743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.111473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 224/435] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:34 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.112249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.160134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f9a77-1ec5-4e2c-a007-bb0231db4315 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.193927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.194720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.194994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.195258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.222541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2c96a-8b7a-4a1f-b047-034c93134f14 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.261893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.262507 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.262790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.263060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.263706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] RBAC: Adding query filter params (name=member) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:35.264005 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.265436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32488a0-02fd-4058-a9e5-bf176d5ee1ec None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.267857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.269337 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.273471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 225/436] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.274699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdca2-a6eb-4208-99ce-8821f8fee0dc None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.274986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdca2-a6eb-4208-99ce-8821f8fee0dc None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.275259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cdca2-a6eb-4208-99ce-8821f8fee0dc None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.280545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 226/437] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:35.281437 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cdca2-a6eb-4208-99ce-8821f8fee0dc None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.283638 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.328855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.365802 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 212/438] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:35.366630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.391785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cdca2-a6eb-4208-99ce-8821f8fee0dc None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.426441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.427058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.427366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.427859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.428451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:35.428663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.430141 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.436400 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 227/439] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.437220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.470810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076531a-8ce6-4767-8666-4eb06f544921 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.487694 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.513754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.514573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.514864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.515108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.516635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.518571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17dcd5-91db-4350-96d6-d3bb96dce18f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.520577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 213/440] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.522402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.522885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.523357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.542981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:35.544329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:35.566752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27573a-ca95-400c-b189-3d8cfeddc62d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.577009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.607523 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.608036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.608309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.608576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.630810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 214/441] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:35.630810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.697693 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.699169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.743519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecd901-52ec-483f-b0a3-f8022c7e2b3d None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.758558 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.782060 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.782780 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.783103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.783489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] PATH_INFO: `/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.784585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c5bdcff0ca2d48e3a4a18b6cd336fc36)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.786154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.788116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 215/442] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/projects/c5bdcff0ca2d48e3a4a18b6cd336fc36 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.788880 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.808810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 228/443] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:35.808810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.817964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:35.899175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e08a5-c993-4d8a-987b-81b0466d78b7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.908534 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86b1d-e8bb-4714-9ca7-0bc1ee9cd5f5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:35.934562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.935265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.935554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.935826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.936506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=04c91b52415947b7ae240c2d7a82ecbd, scope.project.id=60382a301fa147febfb309284f9b660c) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:35.936804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.938466 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:35.943235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:35.943497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:35.943773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:35.952985 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 216/444] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=04c91b52415947b7ae240c2d7a82ecbd => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.953173 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:35.953253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:35.953349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:35.953349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 229/445] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:35.953743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.004410 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.038293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.064850 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f14c3-8f10-4f52-bee9-70cfdb77d45b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.075246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c57b-9b93-43d8-8319-840a55cf1517 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.106143 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.106864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.107139 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.107419 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.108180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:36.108488 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.109981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.113011 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.114197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.114475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.114938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] PATH_INFO: `/v3/projects/60382a301fa147febfb309284f9b660c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.116179 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] RBAC: Authorizing `identity:get_project(project_id=60382a301fa147febfb309284f9b660c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.124985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 230/446] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=c5bdcff0ca2d48e3a4a18b6cd336fc36&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:36.124985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.125263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.125263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 217/447] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:35 2022] GET /identity/v3/projects/60382a301fa147febfb309284f9b660c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:36.125820 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.260417 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3382b5-88b2-4dd3-bb08-3cf1f558b359 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.267315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814a94-3f38-44d6-9755-14c819220d7e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.282060 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.298130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.299232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.299510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.299777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.307029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.307029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.307029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.307029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] PATH_INFO: `/v3/groups/b9df747bf5dc481e91ea0208b698b3c8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.307915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] RBAC: Authorizing `identity:get_group(group_id=b9df747bf5dc481e91ea0208b698b3c8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.309676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.310150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.312007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 218/448] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/groups/b9df747bf5dc481e91ea0208b698b3c8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:36.313641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:36.317627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:36.319347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:36.320231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:53:36.321078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:36.323598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 231/449] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:36.328783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.422454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637aa03-53e3-42ae-a946-48f33f2ab067 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.434472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4452c-5dbf-4918-99f0-12b8cfa674d3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.456661 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.457292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.457574 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.457847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.458565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] RBAC: Adding query filter params (group.id=b9df747bf5dc481e91ea0208b698b3c8, role.id=a8b781dc46fb43c9aaaac21dba171b3c, scope.project.id=60382a301fa147febfb309284f9b660c) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:36.458906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.460336 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.477169 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 219/450] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/role_assignments?group.id=b9df747bf5dc481e91ea0208b698b3c8&scope.project.id=60382a301fa147febfb309284f9b660c&role.id=a8b781dc46fb43c9aaaac21dba171b3c => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:36.477418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.477418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.477418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.477418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.477737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:36.477737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.477737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.480235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 232/451] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:36.486401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.537149 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.596664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d4b19-4820-46ae-8f1e-91a6c9ca896e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.633941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.634539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.634813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.635077 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.709010 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.710467 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.753214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.811231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 220/452] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 00:53:36.817070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:36.881392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:36.922040 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73558a43-f5b7-4682-863f-1ec2da29b541 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:36.959900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:36.960531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:36.960816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:36.961123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] PATH_INFO: `/v3/projects/560e1cc0afb64bafa1e6557ba86b9432` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:36.962268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] RBAC: Authorizing `identity:get_project(project_id=560e1cc0afb64bafa1e6557ba86b9432)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:36.963710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:36.965613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 233/453] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/projects/560e1cc0afb64bafa1e6557ba86b9432 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:36.971245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:37.079186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096183c-0bc4-413f-a140-937e42780a46 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:37.115681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:37.116309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:37.116585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:37.116855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] PATH_INFO: `/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:37.118007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] RBAC: Authorizing `identity:get_group(group_id=26a08a78a74f4ff4a93f9619a8f8b73c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:37.119449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c070e-d455-4904-aad2-440f54db0057 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:37.121028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 221/454] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Aug 19 00:53:36 2022] GET /identity/v3/groups/26a08a78a74f4ff4a93f9619a8f8b73c => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:37.127043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:37.230931 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be816c0-2c52-4ba4-a7bd-ab706dbfa68f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:37.269399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:37.276598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:37.277244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:37.277525 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:37.277795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:37.278520 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] RBAC: Adding query filter params (group.id=26a08a78a74f4ff4a93f9619a8f8b73c, role.id=b63e277927a74d40a291769119d60894, scope.project.id=560e1cc0afb64bafa1e6557ba86b9432) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:37.278826 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:37.280276 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715c88-35d8-4d44-9500-9f48f77d573d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:37.286487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 234/455] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Aug 19 00:53:37 2022] GET /identity/v3/role_assignments?group.id=26a08a78a74f4ff4a93f9619a8f8b73c&scope.project.id=560e1cc0afb64bafa1e6557ba86b9432&role.id=b63e277927a74d40a291769119d60894 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:39.820772 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63e29-2a22-4ea7-a006-84b9e863f991 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:39.820772 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63e29-2a22-4ea7-a006-84b9e863f991 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:39.820772 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63e29-2a22-4ea7-a006-84b9e863f991 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:39.821811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 222/456] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:39.828012 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe86cf-1897-4194-b3b7-d3aab4e22463 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:39.829067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe86cf-1897-4194-b3b7-d3aab4e22463 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:39.829587 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe86cf-1897-4194-b3b7-d3aab4e22463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:39.849336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b1fe86cf-1897-4194-b3b7-d3aab4e22463 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:39.850862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b1fe86cf-1897-4194-b3b7-d3aab4e22463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:39.920948 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 235/457] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:39.987620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aacdd-bac9-41fb-963e-e38f89b17858 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:39.987971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aacdd-bac9-41fb-963e-e38f89b17858 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:39.988182 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039aacdd-bac9-41fb-963e-e38f89b17858 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:39.989936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 223/458] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:39.997427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf7e9-c893-4a22-9a39-844c314f8468 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:39.997707 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf7e9-c893-4a22-9a39-844c314f8468 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:39.998158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf7e9-c893-4a22-9a39-844c314f8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.017602 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-46abf7e9-c893-4a22-9a39-844c314f8468 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:40.019060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-46abf7e9-c893-4a22-9a39-844c314f8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:40.088063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 236/459] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:40.150546 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e12ca-cf45-4a8a-a157-a994aa53e65c None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.150828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e12ca-cf45-4a8a-a157-a994aa53e65c None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.151104 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e12ca-cf45-4a8a-a157-a994aa53e65c None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.152725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 224/460] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:40.158423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.158717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.158996 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.178424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:40.179649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:40.231838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.250123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 237/461] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:40.278061 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e12ca-cf45-4a8a-a157-a994aa53e65c None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.295684 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.390696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e12ca-cf45-4a8a-a157-a994aa53e65c None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.427489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.428121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.428348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.428449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.428654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.441769 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.443656 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-520dec81-e580-47a3-86bf-06629c15a9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:40.460688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:40.461674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:40.462543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:40.462543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.462543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:40.464606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 225/462] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:40.467965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d95bc-2833-4e60-943f-159b5fde89ec None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.468251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d95bc-2833-4e60-943f-159b5fde89ec None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.468671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d95bc-2833-4e60-943f-159b5fde89ec None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.470466 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 226/463] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:40.471375 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d95bc-2833-4e60-943f-159b5fde89ec None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.542147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.546162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad8f5-cd5f-4ab5-a388-bd154a4da4a6 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.582236 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d95bc-2833-4e60-943f-159b5fde89ec None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.585610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.586257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.586533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.586801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.597106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.598562 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-ea164272-7e7f-4585-a79b-850e3eb506cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:40.613042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:40.614099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:40.615067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:40.615067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.615067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:40.615067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 238/464] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:40.615531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.615818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.616089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.622271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.622870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.623152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.623418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.624046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:40.624340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.625734 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.635101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:40.636750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:40.643294 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 227/465] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:40.644388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.666778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.706130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 239/466] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:40.706992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.754532 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c267-47d4-4bcc-8e25-5777ecfa9ce7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.779637 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.792140 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.793022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.793443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.794024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.804670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.805711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993249fd-bf33-424e-816c-a7924bd4c049 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.806155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:40.821696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:40.823042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:40.823879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:40.823879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:40.823879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:40.823879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 228/467] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:40.823879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.847394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.848019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.848300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.848575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.849253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:40.849554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.850936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.862557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 240/468] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:40.867604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:40.896561 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:40.929745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e2084-9042-40b4-b962-cced8a6c1539 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:40.965726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:40.966349 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:40.966703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:40.966976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:40.967723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:40.969206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:40.975905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf93b7-decf-418b-b113-affee50ab88c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.000941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 229/469] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:40 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:41.000941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:41.022215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.022925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.023212 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.023493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.024152 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:41.024462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.025999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.039394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 241/470] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:41.039585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:41.040814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:41.124171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d667d-9faa-4a6c-996e-6fb6f351def9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.136938 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:41.153793 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6237dc-7e23-40ce-b5a2-56f0801fface None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.163628 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.164238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.164748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.164851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.165450 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.166898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.190131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 230/471] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:40 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:41.191367 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:41.194061 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.194719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.195036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.195312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.207247 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.208772 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:41.230043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:41.231046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:41.232708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:41.232708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:41.232708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:41.232708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 242/472] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:41.237536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:41.324948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:41.343985 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad429-bff8-4eef-afe8-6cb2c2bf1271 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.374736 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975a1c9-a883-4531-b9b9-9e1856517991 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.389040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.389766 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.390049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.390324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.391079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.392564 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.420161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 231/473] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:41 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:53:41.426537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.427602 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.428077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.428540 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.429473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:41.430001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.431680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a224a5-b91c-458d-9ee6-bbd60670d2e8 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.441585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:41.449988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 243/474] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:53:41.455504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:41.576233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff7e5a-8b8a-43ec-a104-33eeb32c3ddf None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:41.613223 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:41.614236 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:41.614711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:41.615173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:41.616054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:41.617719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c686be-4754-4055-808d-1c46bd14fcf9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:41.637337 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:41.643458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 232/475] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:53:41 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:53:43.373391 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b755-9d3f-4a9c-a5e2-b5bc75ab4571 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.373900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b755-9d3f-4a9c-a5e2-b5bc75ab4571 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.374006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b755-9d3f-4a9c-a5e2-b5bc75ab4571 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.375598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 244/476] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:43.381161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77395-c64a-42a7-8d0d-fd2ddb0412e1 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.381627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77395-c64a-42a7-8d0d-fd2ddb0412e1 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.381702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77395-c64a-42a7-8d0d-fd2ddb0412e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.401401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-28b77395-c64a-42a7-8d0d-fd2ddb0412e1 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:43.402613 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-28b77395-c64a-42a7-8d0d-fd2ddb0412e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:43.476101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 233/477] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:43.556776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450baaa-89bf-4355-9929-102640c371aa None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.557475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450baaa-89bf-4355-9929-102640c371aa None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.557953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450baaa-89bf-4355-9929-102640c371aa None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.559886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 245/478] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:43.566622 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a11f3-dd73-4c8c-874f-374a0c8e6f7e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.567254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a11f3-dd73-4c8c-874f-374a0c8e6f7e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.567745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a11f3-dd73-4c8c-874f-374a0c8e6f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.587913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5d9a11f3-dd73-4c8c-874f-374a0c8e6f7e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:43.589498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5d9a11f3-dd73-4c8c-874f-374a0c8e6f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:43.665730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 234/479] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:43.732286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2243-0f81-4326-9cba-3676032f2c31 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.732673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2243-0f81-4326-9cba-3676032f2c31 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.733058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e2243-0f81-4326-9cba-3676032f2c31 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.734749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 246/480] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:43.740148 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df7db-0581-49ff-8e8f-1245233ddd56 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.740595 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df7db-0581-49ff-8e8f-1245233ddd56 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.741107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6df7db-0581-49ff-8e8f-1245233ddd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.760652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fd6df7db-0581-49ff-8e8f-1245233ddd56 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:43.762243 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fd6df7db-0581-49ff-8e8f-1245233ddd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:43.825974 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:43.838113 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 235/481] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:43.842391 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2243-0f81-4326-9cba-3676032f2c31 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:43.929305 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3294a-bf0b-4295-ad35-185c78c0fbdc None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.929842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3294a-bf0b-4295-ad35-185c78c0fbdc None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.930279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3294a-bf0b-4295-ad35-185c78c0fbdc None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.931841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 236/482] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:43.938178 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.939391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.939868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:43.950516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e2243-0f81-4326-9cba-3676032f2c31 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:43.967946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:43.969641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:43.990484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:43.991460 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:43.991745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:43.992017 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.006577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:44.012453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.013410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.014214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:44.017033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 247/483] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.019205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.048732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 237/484] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:44.053056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.097369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.142500 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf3cd1-97d0-49dd-abc6-0941a4883279 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.152761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4638d-bbca-418e-acd0-e157c4fe4322 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.176802 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.178042 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.178799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.179200 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.179644 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.190470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:44.194570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.195774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:44.196101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.198197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.200113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:44.201586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.201586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.201586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:44.201586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.201586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.202240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 248/485] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.202793 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.213108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 238/486] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:44.213108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.314580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a2a19-c252-4cf9-b270-04e23a297d25 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.323783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee5f31-9ef3-4d66-afda-213ae4fdad7e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.333093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.351037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476585-5452-4432-8955-475cf905dfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.351592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476585-5452-4432-8955-475cf905dfdf None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.351873 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476585-5452-4432-8955-475cf905dfdf None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.352147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476585-5452-4432-8955-475cf905dfdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.359061 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.359666 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.359945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.360217 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.360919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:44.361239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.362602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.362711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68476585-5452-4432-8955-475cf905dfdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-68476585-5452-4432-8955-475cf905dfdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:44.367250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.368123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 249/487] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.369715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476585-5452-4432-8955-475cf905dfdf None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.376869 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 239/488] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:44.378035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.423057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.470687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476585-5452-4432-8955-475cf905dfdf None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.480677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbfc1c-f511-43b6-950f-9643793474de None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.505027 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.505662 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.505939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.506208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.513925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.514527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.514806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.515079 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.515739 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:44.516043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.516132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.517634 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.518271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.525320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 240/489] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:44.526097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:44.532914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.533864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:44.539404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:44.539404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.539404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:44.539404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 250/490] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.539404 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.565642 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.640085 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d45c-7bdd-48aa-be79-18c2b7802547 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.640269 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec494-db65-408a-b856-097ff87e2031 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.647121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.673505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.673823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.674139 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.674415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.674503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.674684 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.674780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.674973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.685551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:44.686469 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.687964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:44.690616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.691591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:44.692408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 241/491] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.693114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:44.705589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.706652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:44.707678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:44.707678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.707678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:44.707678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 251/492] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.707678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.791270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.796151 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd711-d61d-41af-9d1d-6533c0ec9907 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.811506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d80e-9adb-465c-8937-80aa27be9f40 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.829682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.830057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.830348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.830598 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.842141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.843598 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.846656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.847265 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.847548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.847827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.848482 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:44.848812 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:44.850275 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:44.857242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:44.858191 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:44.859043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:44.859043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:44.859043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:44.859043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 242/493] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:44.859043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.869999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 252/494] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:44.869999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:44.878807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:44.962414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758583f-6b52-45cb-8bb4-f4c0a47d655a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.969003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645e26-5cce-47db-bf90-385b1ac3ae5d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:44.998064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:44.998665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:44.998931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:44.999205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:44.999864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.000166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.002003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.003808 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.004415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.004694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.005000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.005671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.005973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.007335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.015115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 243/495] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.015115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.020020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 253/496] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.020855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.023589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.094527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.114066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616447f-351d-4b60-9399-7290057b72ba None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.122958 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eec73-c1ab-4f92-8552-2222e39707a0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.149158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.149765 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.150048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.150321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.150967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.151271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.152693 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.156013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.156636 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.156935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.157220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.164872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.165402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 244/497] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.166122 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.170920 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:45.184115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:45.185140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 254/498] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:45.186090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.254235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.270594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c5a45-7446-4bc3-af9a-c3522b2ea2ff None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.294796 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a4d-82ec-459e-aac5-48941dd72c70 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.307606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.308550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.308822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.309105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.317800 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.320298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.322283 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.330497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.331130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.331407 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.331681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:45.336796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:45.337732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:45.338581 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:45.338581 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:45.338581 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:45.338581 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 245/499] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:45.338808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.339558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.341056 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:45.353655 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:45.354641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 255/500] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:45.355557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.450918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abae4-8615-466a-b1b0-9661bfca1999 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.460805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48cdec-eebe-4e32-baee-f9df39d91c3c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.483298 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.486088 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.486896 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.487176 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.487470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.495365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.495866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.496471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.496747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.496861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.497060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.497789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.498087 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.499522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:45.509831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:45.510930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:45.511853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 246/501] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:45.512499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.539017 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 256/502] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.540113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.569094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.620646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6a053-6669-43e4-b4d5-06319e0fd69e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.646935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a447c-be50-485c-b7db-eddaa733a5b0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.654957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.655563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.655843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.656114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.656747 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.657081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.659046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.671013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 247/503] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.671796 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.682174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.682799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.683354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.683622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.684344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.684644 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.686113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.703222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 257/504] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.703936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.744373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.774330 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ebb8-fe8f-40e0-83f6-09aff8d815cd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.787430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.805078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab4ab1-6086-4413-8198-7b8d5f2b52c9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.808606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.809265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.809547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.809823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.810543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:45.810843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.812288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.838722 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.839326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.839606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.839879 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.848049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 248/505] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:45.848868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:45.909605 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.911094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:45.947831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25cd58-5d3b-4553-bc1e-ea4bcc81282b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:45.950744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:45.982259 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:45.982885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:45.983164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:45.983435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:45.990543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:45.991982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:46.003946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:46.004853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 249/506] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:46.005798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.015315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 258/507] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:46.016150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.038608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.107285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ea0b-c4c4-45ae-965c-3a144da3c2fe None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.117574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe86676-df60-4d40-9301-178ea1e24d7f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.139665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.140265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.140543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.140811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.150215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.150820 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.151100 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.151374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.164096 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.214340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.215810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.227290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.228756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.245088 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.316167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 250/508] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:46.317424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.331037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 259/509] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:46.332613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.372384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.418270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f18-5c0f-4e82-a24d-fa99204d2baa None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.433795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c70320-0210-45fc-9872-d531198f4467 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.446184 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.452469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.453096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.453363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.453633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.454442 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:46.454737 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.456171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.467833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.468460 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.468736 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.469044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.474367 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 251/510] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:46.475163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.483067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.484532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:46.499324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:46.500380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:46.501906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:46.501906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.501906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:46.501906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 260/511] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:46.501906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.585850 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c2e6-cc9d-4df8-9322-7e3870515af9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.602298 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.613677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429cf69-dc18-4b21-9889-30ac66111c0a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.621322 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.621945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.622224 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.622498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.633223 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.634667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.648193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.648831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:46.649141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:46.650152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:46.651108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:46.651108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.651108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:46.651315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.651315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.651456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 252/512] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:46.651456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.662416 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.663909 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:46.678763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:46.679766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:46.680663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:46.680663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:46.680663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:46.680663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 261/513] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:46.680663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.698587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.757121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50affb76-8071-49dc-bf2a-287c2340ed84 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.778923 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f334f-aa8f-41ce-b360-68d08d79f082 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.789128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.789728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.790003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.790271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.814883 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.815481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.815780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.816035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.816687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:46.817005 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.818378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.830613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 262/514] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:46.831521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.834363 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.858648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.860037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.898733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:46.937248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde2686-f224-490f-ac84-d7e11ed35d97 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:46.960220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 253/515] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:46.961130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:46.971811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:46.972452 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:46.972730 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:46.973109 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:46.973758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:46.974059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:46.975445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:46.986901 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 263/516] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:46.987806 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.049944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.063153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89557e-c1fe-4806-baad-26e470475edb None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.089514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd78cc-5f3b-472c-94e2-97728f633f18 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.096806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.097432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.097711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.097987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.098627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.098929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.100300 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.108284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.113118 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 254/517] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.113909 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.124373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.125049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.125335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.125610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.132765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.134260 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:47.146240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:47.147219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 264/518] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:47.148134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.215300 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d8074-0e27-4014-ba21-799ffea40a10 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.248202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.249105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.249387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.249662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.254632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294de99-5e87-4ba0-aaca-f5804e688df0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.264514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.266022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.278364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:47.280848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:47.282030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:47.282965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:47.282965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:47.282965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:47.285046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 255/519] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:47.285885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.291232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.291865 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.292149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.292426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.299711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.301209 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:47.312940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:47.314201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.315358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:47.316193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 265/520] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:47.316639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.346557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.397820 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0e70-ad60-4bcc-97e3-0d2a657d5e46 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.426012 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e03a4-8357-4e33-808a-01045893d1d3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.430688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.431309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.431582 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.431847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.438863 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.440318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:47.451736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:47.453356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 256/521] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:47.454711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.463256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.463872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.464155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.464538 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.465277 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.465611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.467048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.485150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 266/522] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.486284 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.536771 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.561973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676377df-7a8e-4c9f-8ff2-5c0535a5b0a2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.574976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.595990 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddf4fa-5457-4ba5-aca9-420d8a949ea5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.599908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.600505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.600782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.601083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.601721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.602020 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.603422 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.615841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 257/523] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.616673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.630508 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.631113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.631379 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.631645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.632323 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.632622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.634093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.645825 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 267/524] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.646595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.718186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda720-087c-428d-872e-6808c76ef3a4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.753386 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.753942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d542-4cb9-47fa-917f-ae091783d0ff None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.754049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.754237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.754505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.755181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.755475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.755578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.756899 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.773961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 258/525] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.774755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.790865 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.791473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.791749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.792016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.792739 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=1a6424b0415b4383b7593ae57032d520) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.793057 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.794494 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.800140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 268/526] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/role_assignments?user.id=1a6424b0415b4383b7593ae57032d520&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.800923 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.809729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:47.881279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437f5e-4e12-4274-846f-278310e89b44 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.918169 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.918813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.919092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.919364 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.924006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a69e-f80e-4326-9c03-9f993a7c7d7f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:47.926768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.928267 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:47.940555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:47.941689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 259/527] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:47.942554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:47.968443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:47.969375 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:47.969959 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:47.970507 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:47.971242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=d6b9fb18e69b44d9a896adcf9533998e) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:47.971550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:47.973124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:47.979358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 269/528] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/role_assignments?user.id=d6b9fb18e69b44d9a896adcf9533998e&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:47.980246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:48.015054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:48.070830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:48.083282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbac-b585-4e2a-9a02-cc6269be8c9a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:48.119953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e829ce9-fdff-42f9-911b-8beb8077234b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:48.123841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:48.124713 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:48.125193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:48.125657 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:48.126727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a4e4a153fdc34de3ae75b098acbb165f) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:48.127233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:48.129105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:48.136344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 260/529] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/role_assignments?user.id=a4e4a153fdc34de3ae75b098acbb165f&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:48.163208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:48.163980 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:48.164311 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:48.164652 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:48.165477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:48.165848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:48.167413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc81fb-b28a-4e8e-887b-9cdd27349ded None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:48.182542 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 270/530] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:48.188773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:48.314819 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194b68-f142-41d3-8d2f-8437cd74eef3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:48.350251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:48.350961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:48.351301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:48.351635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:48.352417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=dd7abf396926447ea82b5c2215e9124f) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:48.352785 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:48.354328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0298f-61cd-4a4d-9b5c-05c301e78f22 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:48.361838 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 261/531] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:53:48 2022] GET /identity/v3/role_assignments?user.id=dd7abf396926447ea82b5c2215e9124f&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:50.059338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15ce8-080b-4400-9ebc-f5a00988f37e None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.059892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15ce8-080b-4400-9ebc-f5a00988f37e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.059892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15ce8-080b-4400-9ebc-f5a00988f37e None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.061469 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 271/532] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:50.067464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc150d2-062b-45ba-927c-0bdb7a27fe9d None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.067953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc150d2-062b-45ba-927c-0bdb7a27fe9d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.068028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc150d2-062b-45ba-927c-0bdb7a27fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.089270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5fc150d2-062b-45ba-927c-0bdb7a27fe9d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:50.090488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5fc150d2-062b-45ba-927c-0bdb7a27fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:50.107517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:50.162533 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 262/533] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:50.246254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d931a92-eb4c-47af-a496-35619008ec66 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.246254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d931a92-eb4c-47af-a496-35619008ec66 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.246254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d931a92-eb4c-47af-a496-35619008ec66 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.246892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 272/534] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:50.252529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb18a0-bfa2-4149-b11e-99f41b9e8cc7 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.252814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb18a0-bfa2-4149-b11e-99f41b9e8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.253112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb18a0-bfa2-4149-b11e-99f41b9e8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.272453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-7fbb18a0-bfa2-4149-b11e-99f41b9e8cc7 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:50.273713 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-7fbb18a0-bfa2-4149-b11e-99f41b9e8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:50.352207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 263/535] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:50.443284 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd8bc-fbac-4781-b3e1-55773ccf6147 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.443588 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd8bc-fbac-4781-b3e1-55773ccf6147 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.443843 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecd8bc-fbac-4781-b3e1-55773ccf6147 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.445494 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 273/536] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:50.450782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af904675-cae8-4a61-ad56-9fd518e2054b None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.451078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af904675-cae8-4a61-ad56-9fd518e2054b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.451357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af904675-cae8-4a61-ad56-9fd518e2054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.470018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-af904675-cae8-4a61-ad56-9fd518e2054b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:50.471543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-af904675-cae8-4a61-ad56-9fd518e2054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:50.509744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecd8bc-fbac-4781-b3e1-55773ccf6147 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:50.545441 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 264/537] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:50.574160 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063cca6-0947-43ec-9bb4-ab5392b2c5a2 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.574490 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063cca6-0947-43ec-9bb4-ab5392b2c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.574703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063cca6-0947-43ec-9bb4-ab5392b2c5a2 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.576413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 265/538] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:50.581885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.582184 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.582450 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.605999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:50.607564 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:50.617565 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:50.625263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:50.634465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecd8bc-fbac-4781-b3e1-55773ccf6147 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:50.671629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:50.672807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.673440 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.673910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.689838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:50.694606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:50.695569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:50.696450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 274/539] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:50.697237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:50.701589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 266/540] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:50.702411 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:50.825729 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08424d-482b-4b2d-872f-c81bfb6698ac None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:50.846670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92971-d483-4b1d-87bc-7b1d96de1383 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:50.871256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:50.872708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.873241 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.874002 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.887143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:50.887807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:50.888095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:50.888285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:50.888558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:50.888976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:50.889277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:50.890647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:50.894530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:50.895670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:50.896493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 275/541] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:50.897880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:50.904185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 267/542] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:50.905344 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:50.908817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:50.912294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.006633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b57815-047a-498e-83b8-d397cf7bc485 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.021186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59e5a-358a-41cf-9756-1221b0009469 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.041152 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.041792 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.042070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.042341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.052686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:51.054958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.055559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.055834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.056105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.056759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:51.057090 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:51.057303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.058470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:51.060216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:51.061005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.061099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 276/543] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.061099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.078443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 268/544] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:51.078443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.131051 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.144626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.164027 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05490-d4b2-4d85-9d18-315a7281cda5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.184002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79614116-a764-4893-bd74-5c70b35c1658 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.199335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.200220 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.200501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.200803 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.211421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.212956 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.215734 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.216396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.216659 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.216963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.227025 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:51.227575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.228550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:51.229484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:51.229484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.229484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:51.229484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 277/545] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.229717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:51.232109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.233207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:51.234045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 269/546] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.234786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.342172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448edc-67f0-476c-8c9d-49d257c60530 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.343962 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9310815-4cc0-40b5-bd06-c4a77af83446 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.367580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.367870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.379317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.379959 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.380230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.380354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.380496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.380859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.381249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.381491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.382149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] RBAC: Adding query filter params (name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:51.382456 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.383850 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.390931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.392112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 278/547] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:51.392804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.392928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:51.406858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.407981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:51.408831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:51.408831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.408831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:51.408831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 270/548] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.409592 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.511007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be842b-cf06-4e18-b28f-1a40e9303bba None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.528193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255738c2-3b8d-4163-8800-4832d1c19eac None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.563872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.564867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.565430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.565869 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.566696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:51.567188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.569148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.569746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.571054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.571338 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.571611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.572807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:51.573147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.574573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.584414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 271/550] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:51.584574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 279/550] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:51.585529 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.585848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.628967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.638320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.696520 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995f3e4-e833-4b29-96d5-e7f29db4e461 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.697381 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990d5c-fe2c-4ccc-898e-8ac7ffabb028 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.731812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.732418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.732693 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.732991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.733625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:51.733831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.733954 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.734468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.734742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.735065 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.735318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.746999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 272/551] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:51.747799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.749077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.750686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:51.766339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.767333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:51.769198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:51.769198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.769198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:51.769198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 280/552] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.769198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.850594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.854701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118861-531d-4d78-a767-ddc0662177ff None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.860350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:51.866464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae943c40-e733-46f8-b21e-24892fc9d2b1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:51.889600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.890152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.890430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.890699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.899638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:51.900264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:51.900545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:51.900686 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.900819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:51.902225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.908754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:51.910001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:51.916619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.917565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:51.918449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:51.918449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:51.918449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:51.918449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 273/553] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.918682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:51.920694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:51.922007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 281/554] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:51.924445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.021492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28658a-0cfb-4bdf-8c1b-e271eb40987f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.025270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261158-78a4-4b0f-9a88-f69e7289e933 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.054595 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.055208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.055483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.055749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.058517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.059111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.059386 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.059654 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.060278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.060573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.061972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.063655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.065165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:52.075823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:52.076873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:52.077847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 274/555] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:52.078432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.084470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 282/556] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.084470 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.093510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.100910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.182437 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c523970-a3cb-4741-a192-f55340f4d2a9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.185244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47e1f-e47f-493e-a62f-5327d09f15b0 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.216354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.216977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.217230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.217510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.217825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.218222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.218402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.218501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.218696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.218959 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.219812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.219981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.220135 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.221520 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.232781 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 275/557] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.233605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.242282 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 283/558] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.242616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.300755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.327485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.333266 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaecdb-11b7-41bf-95ce-2a283ebdac5d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.354403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c3190-f3ae-47e9-bbfc-05894a8b0d57 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.367924 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.368530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.368812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.369111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.369830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.370133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.371579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.388867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 276/559] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.389121 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.389710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.389964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.390058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.390332 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.397697 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.399147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:52.410847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:52.412004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 284/560] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:52.413108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.528592 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bdfb4-df6c-4e90-8ebb-3a32b8d066cc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.539543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb0a4-f82a-433a-8a5c-62c0614abb89 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.556981 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.566575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.567197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.567468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.567719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.574661 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.575012 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.575643 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.575925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.576086 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.576199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.578070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.588641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:52.588938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:52.590017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:52.591227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:52.591781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.591852 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 277/561] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:52.591852 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:52.606067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:52.607261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:52.608625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:52.608625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:52.608625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:52.608625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 285/562] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:52.608625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.695436 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b171c49-2310-484e-9ffe-3de965c92573 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.709752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63633-1b03-485d-beba-8deb717d7a92 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.728021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.728653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.728963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.729238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.740355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.741938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.742963 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.743572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.743849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.744120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.744829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.745160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.746576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:52.758089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:52.759054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:52.759943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:52.759943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:52.759943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:52.759943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 278/563] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:52.759943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.769072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 286/564] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.769072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.804481 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.817135 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:52.866995 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148eaa3-6fdc-48fa-9419-86ffc3fa665e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.872868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc44350-1408-4dc6-a517-6d89cd20e20f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:52.899440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.900076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.900355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.900606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.901356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.901648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.903073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.906051 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:52.906669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:52.906971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:52.907276 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:52.907956 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:52.908251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:52.909656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:52.919814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 279/565] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.925242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:52.925531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 287/566] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:52.925531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.020180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18f26-d5a8-4fa8-b630-3961c19d7a4a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.022118 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.022485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.026264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab23cd-5415-4150-9393-3412a0622545 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.056691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.057283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.057873 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.058145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.059636 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e309ef-afde-4965-963e-62551434347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.060239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e309ef-afde-4965-963e-62551434347d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.060510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e309ef-afde-4965-963e-62551434347d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.060788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e309ef-afde-4965-963e-62551434347d None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.061459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e309ef-afde-4965-963e-62551434347d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:53.061760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e309ef-afde-4965-963e-62551434347d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.063182 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e309ef-afde-4965-963e-62551434347d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.069567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.071024 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.074054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 280/567] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:53.074839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e309ef-afde-4965-963e-62551434347d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:53.085714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.086764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:53.087819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:53.087819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:53.087819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:53.087819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 288/568] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.090026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.186235 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e309ef-afde-4965-963e-62551434347d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.198616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a946668-efa7-4ba1-a286-78598e6d2f7f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.220455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.221109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.221379 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.221644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.231710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.232328 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.232604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.232867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.232998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.234452 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.239780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.241384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:53.250987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.252066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:53.252999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:53.252999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:53.252999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:53.252999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 281/569] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.253235 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:53.257544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.258435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:53.259394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 289/570] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.261052 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.270765 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.281079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.359038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafc66a-23fb-4da6-99d4-a6ce5c04d5b1 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.364681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea76d3-859b-447f-bbaf-dda92e515520 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.392005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.392631 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.392936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.393213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.397479 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.398079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.398356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.398628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.399426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:53.399716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.399858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.401142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.401273 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:53.412526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.413590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.419783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:53.420339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 290/571] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:53.420448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 282/572] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.420583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.420719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.489325 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.495680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.519874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752131-9ce8-455f-8cad-c04bccf82387 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.520037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fb21-92b3-4ab0-a350-cc8740efbca3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.553550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.553764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.554147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.554255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.554420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.554515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.554688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.554790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.555345 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:53.555437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:53.555648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.555742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.557043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.557156 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.570606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 291/573] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:53.576576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 283/574] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:53.576743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.576841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.674679 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c69c40-1959-4fd2-adfc-e37d64b3b0b9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.679201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcee31f-2998-4434-ab4d-e094c8ef13a8 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.702470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.708601 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.709228 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.709505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.709777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.710586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:53.710886 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.712316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.713388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.714016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.714294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.714560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.717298 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.722436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.723868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.724366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 284/575] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:53.725197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:53.735800 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.736884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:53.737919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 292/576] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.738405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.837982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579e02-9a74-44c5-a06d-1ce2be0974cc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.844778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8537da-529c-455c-a789-e69e5da3bbf2 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:53.871997 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.872626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.872922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.873200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.878466 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:53.879145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:53.879454 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:53.879717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/1a6424b0415b4383b7593ae57032d520/roles/33f19ac7355d4ff5bfd925e8c8140a99` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:53.880022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.881505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:53.893321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:53.894241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 285/577] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:53.895788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.899855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=1a6424b0415b4383b7593ae57032d520, role_id=33f19ac7355d4ff5bfd925e8c8140a99)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:53.901468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:53.915280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 293/578] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:53 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/1a6424b0415b4383b7593ae57032d520/roles/33f19ac7355d4ff5bfd925e8c8140a99 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:53.916090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:53.967200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:53.973090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:54.026538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d5ce3-0c65-4d38-9616-c592508ffff9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:54.039879 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17334a4-b489-4891-87b4-3b71d284eb16 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:54.064103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:54.064871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:54.065185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:54.065462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/d6b9fb18e69b44d9a896adcf9533998e/roles/33f19ac7355d4ff5bfd925e8c8140a99` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:54.080166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:54.081430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:54.081954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:54.082368 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:54.082481 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=d6b9fb18e69b44d9a896adcf9533998e, role_id=33f19ac7355d4ff5bfd925e8c8140a99)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:54.083310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:54.083828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:54.083964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:54.085575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:54.100688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 286/579] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:53 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/d6b9fb18e69b44d9a896adcf9533998e/roles/33f19ac7355d4ff5bfd925e8c8140a99 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:53:54.101427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:54.106392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 294/580] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:54.112815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:54.234643 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:54.240205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e45c-aa7f-44ed-9251-4ebd7a975e97 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:54.254499 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597357fb-2700-4a10-8cd9-ad97c43ece84 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:54.264100 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:54.294917 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:54.295945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:54.296424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:54.296919 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:54.297755 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:54.298425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:54.298703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:54.298850 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:54.298998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a4e4a153fdc34de3ae75b098acbb165f/roles/33f19ac7355d4ff5bfd925e8c8140a99` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:54.299173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:54.300675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:54.316013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 287/581] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:54.316825 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=a4e4a153fdc34de3ae75b098acbb165f, role_id=33f19ac7355d4ff5bfd925e8c8140a99)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:54.318924 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c6e2-12fe-47eb-abed-3f0573e78747 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:54.322374 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:54.335790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 295/582] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:54 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a4e4a153fdc34de3ae75b098acbb165f/roles/33f19ac7355d4ff5bfd925e8c8140a99 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 00:53:54.457395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668df50-1f52-41ee-b554-1fbf90828d08 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:54.505556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:54.506147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:54.506423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:54.506693 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/dd7abf396926447ea82b5c2215e9124f/roles/33f19ac7355d4ff5bfd925e8c8140a99` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:54.523173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=dd7abf396926447ea82b5c2215e9124f, role_id=33f19ac7355d4ff5bfd925e8c8140a99)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:54.524614 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b38a-1f08-41e5-ab1a-43920bbc34ad None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:54.540546 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 288/583] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:53:54 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/dd7abf396926447ea82b5c2215e9124f/roles/33f19ac7355d4ff5bfd925e8c8140a99 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 00:53:56.174630 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3e0d-4ccc-4745-96f0-b06dd87b6142 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.175157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3e0d-4ccc-4745-96f0-b06dd87b6142 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.175157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3e0d-4ccc-4745-96f0-b06dd87b6142 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.176583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 296/584] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:56.182016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058158a-b654-45b8-bac9-2b97be28cf21 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.182729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058158a-b654-45b8-bac9-2b97be28cf21 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.182898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058158a-b654-45b8-bac9-2b97be28cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.201007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-7058158a-b654-45b8-bac9-2b97be28cf21 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:56.202180 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-7058158a-b654-45b8-bac9-2b97be28cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:56.205170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:56.275780 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 289/585] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:56.482084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda276b9-ce04-4e7e-bb06-afed2e67bfc3 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.482282 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda276b9-ce04-4e7e-bb06-afed2e67bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.482562 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda276b9-ce04-4e7e-bb06-afed2e67bfc3 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.484144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 297/586] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:53:56.490449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.491026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.491521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.510928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:56.512522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:56.522257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd31b2-122d-4c42-b520-3b911fc35789 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.522543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd31b2-122d-4c42-b520-3b911fc35789 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.522823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd31b2-122d-4c42-b520-3b911fc35789 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.524438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 298/587] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:56.529176 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.529465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.529737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.548202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:56.549422 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:56.604401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 290/588] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:56.618781 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:56.626124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 299/589] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:53:56.689838 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:56.726292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe89b-a943-4c25-a83b-411a9db15745 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:56.760562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:56.761147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.761418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.761683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.771911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-e611f526-1acd-4aad-9096-59005731e9e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:56.776494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:56.777449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:56.778285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:56.782469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 291/590] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:56.783828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:56.861650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f923b-c37b-4802-a1a1-f113d2e34c87 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.861975 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f923b-c37b-4802-a1a1-f113d2e34c87 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.862236 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f923b-c37b-4802-a1a1-f113d2e34c87 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.863840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 292/591] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:53:56.868746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.869087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.869368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.871771 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:56.892347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d94ad1-243e-4c57-bcc3-b7e3432be326 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:56.893115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:53:56.894393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:53:56.931382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:56.932255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:56.933765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:56.934051 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:56.934732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] RBAC: Adding query filter params (name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:56.935061 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:56.936531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:56.948356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 300/592] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:56.951673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:56.970567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 293/593] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:53:56.971505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.036332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.064251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20875c-e5e6-4783-b613-e727de9f9bbd None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.083477 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5aad0-096f-4dcc-87e5-e474e8f41508 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.098710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.099533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.099948 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.100354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.111257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:57.116649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.117767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.118799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:57.119575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.119575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.119575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.119885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.121442 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 301/594] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:53:57.122517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.133597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.137501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.139555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:57.154888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.155846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:57.156846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:57.156846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.156846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:57.156846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 294/595] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.156846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.232322 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a165-5203-43fd-8638-6649270db181 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.271285 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.272336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.272829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.273370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.285302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e74cc-de44-4a68-815a-10d90359a85f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.285761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:57.290801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.291763 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:57.292651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 302/596] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.293423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.300998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.323468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.324080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.324363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.324632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.325328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:57.325627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.327018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.335328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 295/597] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:57.336149 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.367942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.403565 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac5dd-c19a-44a0-98ce-09ecdb345c74 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.436499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2bb2-0abd-4085-9e58-81fe7717d195 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.437041 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.437720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.438114 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.438567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.439221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:57.439553 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.441039 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.452972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 303/598] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:57.454044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.472704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.473423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.473730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.474029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.484583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:53:57.489986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.490910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 296/599] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.492332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.527725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.556858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eb246-e06d-4c08-b153-e005ad7cb2a2 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.585793 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.594559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.595261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.595450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.595715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.596077 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af1fdd-aa5e-4f83-8033-e3e2bae24e3e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.596366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] RBAC: Adding query filter params (name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:57.596661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.598075 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.605858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 304/600] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:57.606629 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.630929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.631566 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.631846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.632122 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.642960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.644427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:57.659591 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.660542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:57.661470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:57.661470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.661470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:57.662105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 297/601] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.662805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.710946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9851-9e52-44e9-8c48-3c14749362ea None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.744149 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.744769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.745074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.745336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.749189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.753007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.754458 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.764625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c916-5570-4f11-a709-f736e69862f6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:57.765251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.766364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 305/602] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.767626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.802774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.803383 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.803671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.803940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.804595 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:57.804923 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.806328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.814642 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 298/603] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:57.815426 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.821435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:57.872253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd097e0-5dfe-42ad-b14e-8cef3ed81dd6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.904487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.905151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.905431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.905704 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.916116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.916771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c759ef-9f53-4ab7-9c4b-d869c054a6c9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:57.917580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:57.931577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:57.932855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:57.933789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:57.933789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:57.933789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:57.933789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 306/604] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:57.933789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.954134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:57.954729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:57.955008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:57.955277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:57.955903 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:57.956197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:57.957579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:57.969786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 299/605] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:57.970562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:57.981845 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.029798 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45764b-0f5e-4910-aa2a-614e5a228a3f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.031315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.064002 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.064779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.065103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.065409 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.066110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:58.066423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.067860 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.069385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109f99-8e7c-46dd-ae3b-0ed87da828fe None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.086014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 307/606] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:58.086014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.104098 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.104725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.105033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.105302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.115464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.117057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:58.131026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:58.132129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:58.133159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:58.133159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:58.133159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:58.133159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 300/607] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:58.133159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.192023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.196188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a1c46-7534-41db-9cfc-77897c271607 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.229899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.230509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.230788 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.231089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.231720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:58.232037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.233453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.235396 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd1fbf-fcfd-4066-b3b0-406ee36c56a2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.249023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 308/608] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:58.249023 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.272160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.276773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.277514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.277798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.278073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.285599 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.287046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:58.297927 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:58.298989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:53:58.299932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:58.301051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 301/609] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:58.301911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.353254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b984a-27ed-4e2d-9d71-9cebc4c4030f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.390501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.391122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.391472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.391745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.405007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24b11-b87d-4006-894f-129ae4a62905 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.425730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.440559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.441198 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.441482 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.441757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.442399 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:58.442703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.444085 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.455594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 302/610] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:58.456382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.461998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.463603 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.484222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.562510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6b42-a016-4554-89c1-9a301130157d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.563614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 309/611] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:58.564451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.603415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.603962 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.604243 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.604511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.613529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.615016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:58.626926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:58.628054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 303/612] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:58.629210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.668236 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.671524 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e54c7-ad66-4eae-ad9c-964abf1070ac None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.691770 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.705472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.706097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.706367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.706633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.707344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:58.707646 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.709098 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.726295 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 310/613] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:58.727910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67635f-0c49-47db-a88d-699e8d37c83b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.729913 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.762428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.763051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.763352 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.763645 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.771790 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.773313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:53:58.784866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:58.786030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 304/614] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:58.787213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.836826 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d6907-8130-4da3-a509-3a74e392edb3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.878646 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.879232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.879551 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.879858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.890327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.892268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.895057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.898369 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd64af7-c1ae-4f6f-872e-05fb8e7e08c9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:58.907560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:58.908656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:58.914356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:58.914356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:58.914356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:58.914356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 311/615] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:58.914356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:58.935023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:58.935632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:58.935911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:58.936226 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:58.936987 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:58.937292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:58.938722 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:58.943289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:58.956536 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 305/616] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:58.957413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.016452 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15923e-b285-4d83-8930-13c914ec7bb5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.052093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.052791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.053156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.053436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.056149 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16536a5-b008-4729-9544-671656cdcda4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.093557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.094340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.094644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.094932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.095696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:59.095986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.097478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.114876 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 306/617] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:59.115692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.128379 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.129932 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.134865 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.165320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.219036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ec99-265c-463c-81ff-de99f1ec4159 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.238610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 312/618] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:59.239445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.256793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.257453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.257731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.258005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.258640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:53:59.258938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.260290 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.271673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 307/619] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:53:59.272493 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.346475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9319-7071-4f31-b147-d800de90552c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.347472 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.369481 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d610-47bf-434d-aaa1-7718e6042eb1 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.375677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.382905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.383447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.383725 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.383997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.402540 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.403168 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.403448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.403745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.453496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.454922 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.469797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.471231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.551117 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 313/620] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:59.552048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.552862 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.576333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 308/621] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:53:59.577188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.584656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.662641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6e3cc-14be-4ac7-a890-6857882be49f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.687248 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab3801-e922-4c3a-aa4e-b1014de30157 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.698828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.699462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.699735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.700007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.710891 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.712338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.721727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.722361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.722642 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.722913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:59.726689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:59.727776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:59.728688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:59.728688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.728688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:59.728688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 314/622] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:59.728688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.733550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.735130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:53:59.746303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:59.747394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 309/623] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:59.748485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.794279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.828592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:53:59.851116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736c93-8fc1-4890-9070-9f534979d171 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.870641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf834-523c-4666-9d4a-4ec90696ca37 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:53:59.887267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.887904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.888243 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.888495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.908982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.910615 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.920334 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:53:59.921180 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:53:59.921630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:53:59.922471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:59.934569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:59.936137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:59.937112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:59.937112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.937112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:53:59.937112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 315/624] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:59.937609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:53:59.944851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:53:59.946358 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:53:59.962827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:53:59.970971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:53:59.972155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:53:59.972155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:53:59.972155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:53:59.972155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 310/625] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:53:59.972155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.054248 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69573e61-e1c8-40e6-81bb-1ac73d226fa0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.067486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.081199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce10d48-485c-42b3-adb4-01b23f464d54 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.092695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.093488 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.094085 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.094552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.095443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.095751 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.097229 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.098943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.112961 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 316/626] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.113933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.124556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.125446 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.125904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.126242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.127365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.127848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.129463 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.143062 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 311/627] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.143903 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.229022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e371-30bd-418f-8b1b-af528ec094c8 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.257853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6c18e-c414-4cc3-88b4-9b5d576d2384 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.270240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330290-7e6f-436a-a641-927c78154add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.270992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330290-7e6f-436a-a641-927c78154add None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.271269 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330290-7e6f-436a-a641-927c78154add None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.271543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab330290-7e6f-436a-a641-927c78154add None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.272260 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330290-7e6f-436a-a641-927c78154add None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.272531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330290-7e6f-436a-a641-927c78154add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.274007 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab330290-7e6f-436a-a641-927c78154add None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.288370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 317/628] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.289419 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330290-7e6f-436a-a641-927c78154add None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.301005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.301722 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.302002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.303233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.303233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.303431 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.304799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.317854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 312/629] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.318686 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.330484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.359413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.412405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab330290-7e6f-436a-a641-927c78154add None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.436478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155efff1-5ddf-4712-9787-df47ea5cac71 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.460611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.461286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.461571 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.461887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.468965 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.470641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.478789 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.479751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.480141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.480568 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.481621 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=1a6424b0415b4383b7593ae57032d520) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.481925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.483450 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:00.483545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:00.484669 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 318/630] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:00.485783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.494826 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 313/631] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/role_assignments?user.id=1a6424b0415b4383b7593ae57032d520&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.495856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.600799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.614751 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792766-8066-4cc0-8eb3-4110d64ae192 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.631327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.637543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349a7db-5780-48d0-b50f-9bd5bd457971 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.659372 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.660036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.660319 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.660621 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.670933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.672544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.676264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.676937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.677245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.677510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.686023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.687642 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:00.688068 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:00.690158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 319/632] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:00.692814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:00.706787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:00.707771 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 314/633] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:00.713993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.819774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d061-ebca-412c-a684-2fd0fafefcc4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.843361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fff68-1147-49e2-ab50-3755bd4df9db None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:00.871252 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.871871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.872153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.872463 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.873175 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.873614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.875306 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.877442 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:00.890692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:00.891216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:00.891611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:00.891883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:00.894107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:00.894107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:00.894362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:00.896613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 320/634] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.897797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.912807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 315/635] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:00.913946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:00.941474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:01.020125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fac02-f746-4b5b-b1fc-85c2f79684cd None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:01.028063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249dbe-2ce8-4d03-af27-a6126982c7f4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:01.061096 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:01.061748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:01.062025 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:01.062318 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:01.063120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:01.063424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:01.064978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:01.077711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:01.078332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:01.078735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:01.084165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:01.084352 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 321/636] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:01.084454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a4e4a153fdc34de3ae75b098acbb165f) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:01.084454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:01.084684 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:01.084799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:01.089161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 316/637] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:00 2022] GET /identity/v3/role_assignments?user.id=a4e4a153fdc34de3ae75b098acbb165f&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:01.089789 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:01.167825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:01.215743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7b44a-263d-4784-a52b-c79a9cb52cb5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:01.226103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4e4a-623e-4dca-86f4-b9b8e0c6b832 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:01.237297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:01.270939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:01.271821 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:01.272105 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:01.272814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:01.273868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=d6b9fb18e69b44d9a896adcf9533998e) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:01.274181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:01.276781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f505a2-6d53-4cf9-bde1-d5f04bb0dc76 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:01.281890 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:01.282744 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:01.283134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:01.283410 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:01.284133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=dd7abf396926447ea82b5c2215e9124f) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:01.284426 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:01.285397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 322/638] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:01 2022] GET /identity/v3/role_assignments?user.id=d6b9fb18e69b44d9a896adcf9533998e&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:01.285915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859e02-7335-4d5b-a311-aaf38e053434 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:01.293650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 317/639] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:01 2022] GET /identity/v3/role_assignments?user.id=dd7abf396926447ea82b5c2215e9124f&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:02.799927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbe5b-6ff0-4368-bb75-bc9724969c6c None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:02.800477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbe5b-6ff0-4368-bb75-bc9724969c6c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:02.800477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bbe5b-6ff0-4368-bb75-bc9724969c6c None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:02.802130 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 323/640] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:02.807914 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700240-eeb8-4c45-820b-7e2658619f87 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:02.808340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700240-eeb8-4c45-820b-7e2658619f87 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:02.808615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e700240-eeb8-4c45-820b-7e2658619f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:02.827931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-4e700240-eeb8-4c45-820b-7e2658619f87 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:02.829571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-4e700240-eeb8-4c45-820b-7e2658619f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:02.901650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 318/641] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:54:03.238259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bbe5b-6ff0-4368-bb75-bc9724969c6c None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:03.362769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bbe5b-6ff0-4368-bb75-bc9724969c6c None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:03.397137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:03.398034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.398501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.398929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.402727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8338c-52fb-43f6-be6d-151b78104657 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.403014 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8338c-52fb-43f6-be6d-151b78104657 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.403292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8338c-52fb-43f6-be6d-151b78104657 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.404879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 319/642] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:03.410949 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a0d6-c39b-41b0-bdf7-2538dd7941b2 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.411228 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a0d6-c39b-41b0-bdf7-2538dd7941b2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.411501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280a0d6-c39b-41b0-bdf7-2538dd7941b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.412236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:54:03.417887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:03.419013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:03.419943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:03.424839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 324/643] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:03.425930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:03.436549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0280a0d6-c39b-41b0-bdf7-2538dd7941b2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:03.438922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0280a0d6-c39b-41b0-bdf7-2538dd7941b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:03.455716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:03.509248 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:03.540956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 320/644] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:54:03.557724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01c81d-972a-4965-97c6-712f71a15fc4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:03.598304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:03.598914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.599194 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.599509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.600183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:03.600485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:03.601919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:03.606427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1552-1d7c-4729-8b97-9bc6eb51e9a9 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.606956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1552-1d7c-4729-8b97-9bc6eb51e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.607420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1552-1d7c-4729-8b97-9bc6eb51e9a9 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.609397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 321/645] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:03.611234 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 325/646] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:03.616005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ce9b-ccbe-4ddd-b383-a0dc298af1d9 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.616289 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ce9b-ccbe-4ddd-b383-a0dc298af1d9 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.616558 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ce9b-ccbe-4ddd-b383-a0dc298af1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.617884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:03.635805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-3d40ce9b-ccbe-4ddd-b383-a0dc298af1d9 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:03.637016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-3d40ce9b-ccbe-4ddd-b383-a0dc298af1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:03.709113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:03.716822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 322/647] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:54:03.716822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708746-59cf-4bab-a063-189bc834cb1c None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.716822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708746-59cf-4bab-a063-189bc834cb1c None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.716822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708746-59cf-4bab-a063-189bc834cb1c None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.716822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 323/648] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:03.717885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.718163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.718542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.736587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:03.737365 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8b9ea-0403-4ff5-894f-608258190685 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:03.737779 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:03.772441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:03.776926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.776926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.776926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.784852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:03.786351 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:03.802919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:03.804575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:03.805600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:03.805600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:03.805600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:03.805600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 326/649] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:03.809976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:03.815896 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 324/650] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:54:03.883648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:03.915294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ed9-8f38-4cd7-9cf8-258c66780f7f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:03.929263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:03.953579 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:03.958988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:03.959838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:03.960237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:03.960581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:03.961810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:03.962183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:03.963922 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:03.983768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 327/651] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:03.985029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.002733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1ac1c-f556-43ef-aa7d-1ce2cab74860 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.048305 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.049496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.049989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.050807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.051625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.053852 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:04.068562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:04.069654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:04.070522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.072984 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 325/652] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:54:04.073971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.108159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299a920-ad2b-42c3-95bc-73a3cba4f228 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.144571 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.145229 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.145508 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.145778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.152999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.154454 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:54:04.165653 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:04.166619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:04.167583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 328/653] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:54:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:04.168193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.179827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bcd-9be3-45a7-a317-bb2ac1daacdf None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.183034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.217561 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.218222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.218507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.218791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] PATH_INFO: `/v3/services/image` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.219378 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.220772 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.222847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:04.229998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:04.231159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.232131 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 326/654] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:04.233075 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.277661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473025da-915b-4626-afdb-3da2e7096b1a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.310389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.310920 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.311206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.311478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.312181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.312586 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.314016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.318339 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 329/655] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.319114 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.336059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509fcc-b24c-4d43-959c-2c780ce77e0a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.370535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.371161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.371437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.371707 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] PATH_INFO: `/v3/services/network` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.372288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.373685 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:04.382388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:04.383430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:04.384474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 327/656] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:04.385343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.419118 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.420395 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd822f6-91e8-4a7b-a87e-45ae7534c9fe None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.439143 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.458880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.459489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.459765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.460030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.460773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.461111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.462544 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.479519 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 330/657] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.480131 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.496692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c391172-ab92-4b83-8a9a-f8d6ef0e172e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.532150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.532757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.533071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.533346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.533969 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] RBAC: Adding query filter params (name=image) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.534268 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.535638 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.540208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 328/658] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.541023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.580377 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74e3e-37f6-4893-a796-72dc1c42862e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.615424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.616033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.616313 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.616585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.617256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.617561 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.618941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.624397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 331/659] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.625081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.658341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.667988 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.668874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b5ec-8c80-436e-9348-cad921a93459 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.711516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.712130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.712549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.712654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.713328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] RBAC: Adding query filter params (name=network) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.713834 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.715128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.720399 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 329/660] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.725860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.738832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01614-4c04-4d81-b1ae-6a8d478f241c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.777293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.778004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.778290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.778606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.841886 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f854-ad5a-4250-ab33-560ed33498cd None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:04.859376 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.861049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.875891 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:04.876499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:04.876777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:04.877125 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:04.877718 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:04.878017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:04.879370 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:04.885091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 330/661] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:04.885875 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:04.920161 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:04.926109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:05.009649 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 332/662] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 00:54:05.010884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:05.028351 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3924cd-f94b-4355-8186-a0761c4ed5e6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.066878 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.067504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.067783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.068056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.068690 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:05.069024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.070423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.075726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 331/663] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:05.147841 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c174-2a88-4b68-b9f5-02c7a008db66 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.187280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.188107 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.188385 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.188654 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.196695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:05.201908 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.203915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:05.220701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:05.221753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:05.222666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:05.222666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:05.222666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:05.222666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 333/664] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:05.229354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:05.336606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:05.349073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b8e-70e9-4c96-97a3-268c8c8793f6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.383152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.383761 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.384038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.384308 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.384968 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:05.385272 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.386655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.399099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 332/665] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:05.404243 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:05.516005 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c78108-5ece-4c0b-bdce-8a324da62cc9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.550193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.551187 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.551699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.552174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.559415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.561118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:05.572735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:05.573705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:05.574628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:05.577225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 334/666] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:05.585899 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:05.689043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678d6a-e1b5-4fc2-9912-22d1178f9204 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.724507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.725137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.725417 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.725685 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.726374 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:05.726676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.728107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2afa7-2a27-4eb4-a956-a29093b5313a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.740268 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 333/667] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:05.746421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:05.798748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:05.854799 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983119-2e83-4b73-a336-492a3b96ceb9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:05.896675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:05.897327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:05.897576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:05.897851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:05.898596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=1a6424b0415b4383b7593ae57032d520) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:05.898906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:05.900365 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384309-0267-40de-ab35-7c2b8c6c69ee None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:05.906758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 335/668] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:05 2022] GET /identity/v3/role_assignments?user.id=1a6424b0415b4383b7593ae57032d520&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=b63e277927a74d40a291769119d60894 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:06.967727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21dccf-8945-42d6-8961-843a796f2b24 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:06.968298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21dccf-8945-42d6-8961-843a796f2b24 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:06.968384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21dccf-8945-42d6-8961-843a796f2b24 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:06.970532 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 334/669] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:06.975897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7484e-3174-4107-9a17-4434f7a3d653 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:06.976357 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7484e-3174-4107-9a17-4434f7a3d653 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:06.976436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7484e-3174-4107-9a17-4434f7a3d653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:06.997059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d6c7484e-3174-4107-9a17-4434f7a3d653 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:06.998296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d6c7484e-3174-4107-9a17-4434f7a3d653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:07.077009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 336/670] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:54:07.159133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c99-4689-4c05-be7c-9ba58601d46a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.159584 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c99-4689-4c05-be7c-9ba58601d46a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.160034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c99-4689-4c05-be7c-9ba58601d46a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.162516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 335/671] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:07.169016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d1c2-e07a-4d7d-94ac-4e726e06a49c None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.169308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d1c2-e07a-4d7d-94ac-4e726e06a49c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.169607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d1c2-e07a-4d7d-94ac-4e726e06a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.189308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-5a57d1c2-e07a-4d7d-94ac-4e726e06a49c None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:07.190490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5a57d1c2-e07a-4d7d-94ac-4e726e06a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:07.233374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:07.266197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 337/672] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 00:54:07.296931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6122-099b-4bfe-8896-8cc56d83dad5 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.297247 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6122-099b-4bfe-8896-8cc56d83dad5 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.297506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6122-099b-4bfe-8896-8cc56d83dad5 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.299078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 336/673] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:07.304192 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.304478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.304756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.329228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:07.330427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:07.398071 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 338/674] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 00:54:07.418960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6122-099b-4bfe-8896-8cc56d83dad5 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:07.431375 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:07.532110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6122-099b-4bfe-8896-8cc56d83dad5 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:07.567040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:07.567890 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.568312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.568724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.569559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:07.571080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:07.589397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 337/675] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:07 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:54:07.590236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:07.716962 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4ad9c-d40d-4eff-bb5b-0cf646867775 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:07.720325 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:07.762887 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:07.766270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:07.766901 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.767174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.767445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.768147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:07.769634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d66a-342f-45f3-8aac-e4f506f9707c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:07.790484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 339/676] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:07 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:54:07.850954 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:07.893822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86564-0218-42e4-a1f1-9d0e15f390db None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:07.944186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:07.944806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:07.945112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:07.945382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:07.946040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:07.947423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175837c3-0092-4e8f-9346-818fedf52755 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:07.971867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 338/677] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:07 2022] POST /identity/v3/services => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:08.321576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f12dd-f8da-4875-9e6c-36b4af76e784 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:08.322097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f12dd-f8da-4875-9e6c-36b4af76e784 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:08.322175 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f12dd-f8da-4875-9e6c-36b4af76e784 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:08.325113 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 340/678] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:08.331316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:08.331593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:08.331876 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:08.354443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:08.355712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:08.435990 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 339/679] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:08.775907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f12dd-f8da-4875-9e6c-36b4af76e784 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:08.884326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f12dd-f8da-4875-9e6c-36b4af76e784 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:08.918835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:08.919466 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:08.919740 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:08.920013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:08.931010 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:54:08.936022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:08.937115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:08.937986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 341/680] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:08.943993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:08.996174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:09.052831 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97e8d-738f-4f56-98c0-bf22b2b81f0a None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.090048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.090657 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.090930 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.091196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.091859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:09.092161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.093748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.102441 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 340/681] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:09.108020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:09.153447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:09.213890 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376e10-4e9c-43c8-b0b6-e6879b9c1748 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.247692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.248382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.248662 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.248954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.260006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.261503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:09.275627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:09.278219 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:09.280312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:09.280312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:09.280312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:09.280312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 342/682] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:54:09.282586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:09.387138 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985ab0-0f0e-4d02-a4e8-93184a5a46cf None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.400615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:09.423805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.424649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.425284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.425701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.426499 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:09.427017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.428523 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.442577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 341/683] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:09.452916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:09.522519 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:09.553668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d331c8-0849-48d6-b37e-2210ba01ad40 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.588486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.589162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.589439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.589708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.598486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.600490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:54:09.617872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:09.618867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:09.619815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:09.620368 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 343/684] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:09.625914 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:09.731150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0943-d0f5-446e-a243-e80076ca022e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.766061 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.766670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.766949 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.767221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.767951 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:09.768251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.769709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.787660 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 342/685] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:09.794936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:09.917087 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad8ce9-9abf-4409-99f2-c36c6a30c0f0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:09.948411 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:09.954266 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:09.954960 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:09.955242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:09.955509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:09.967375 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:09.969002 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-1845cbb7-ad06-44fb-8b86-af0ddf428e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:09.983310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:09.984402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:09.985435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:09.985435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:09.985435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:09.985435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 344/686] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:09.990870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.003559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf1ed-f34f-40be-bd7c-38883118eeeb None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.004187 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf1ed-f34f-40be-bd7c-38883118eeeb None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.004630 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf1ed-f34f-40be-bd7c-38883118eeeb None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.006492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 345/687] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:10.011985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceefce-023d-48d9-872c-42e5a384e96a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.012450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceefce-023d-48d9-872c-42e5a384e96a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.012956 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceefce-023d-48d9-872c-42e5a384e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.029040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.034976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b7ceefce-023d-48d9-872c-42e5a384e96a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:10.037389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b7ceefce-023d-48d9-872c-42e5a384e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:10.108307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 346/688] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:10.110084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4425b-9b00-475b-b4ff-97d5dbc95e03 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.110433 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4425b-9b00-475b-b4ff-97d5dbc95e03 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.110765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4425b-9b00-475b-b4ff-97d5dbc95e03 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.112235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 347/689] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:10.117506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b93dd-3d60-4af3-ab59-b8132602099a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.117786 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b93dd-3d60-4af3-ab59-b8132602099a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.118048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b93dd-3d60-4af3-ab59-b8132602099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.119908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31259f36-cfd0-4163-9e3b-391e4be09e18 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.137270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1d9b93dd-3d60-4af3-ab59-b8132602099a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:10.138498 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1d9b93dd-3d60-4af3-ab59-b8132602099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:10.168291 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.169943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.170445 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.170894 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.172632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:10.173435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.175512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.190188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 343/690] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:10.195918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.224402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 348/691] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:10.294534 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057e5a-e6b1-40c1-bde2-bec6c652c6bd None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.294887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057e5a-e6b1-40c1-bde2-bec6c652c6bd None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.295142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057e5a-e6b1-40c1-bde2-bec6c652c6bd None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.296868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 349/692] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:10.300451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.306424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.307282 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.307928 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.311181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e22038-f8f6-4b37-bdd3-b67e97c0db2a None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.331466 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:10.333537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:10.348170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.348808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.349119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.349392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.356740 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.358526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:10.370487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:10.371409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:10.372311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 344/693] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:10.378296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.386271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.433425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 350/694] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:10.468986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.508830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3683-1cd6-4aeb-9180-ff615718e168 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.552501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.553174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.553477 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.553743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.554458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:10.554791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.556261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.569310 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 345/695] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:10.570150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.582734 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.591327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5ed23-7257-4866-8ea9-d0bdc7adfea6 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.626557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.627303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.627597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.627867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.628453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.629866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:10.641537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:10.642728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:10.643696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 351/696] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:54:10.648469 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.690452 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfe8c8-86c6-41f4-901b-73bc103410f6 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.693428 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.727731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.728494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.728791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.729076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] PATH_INFO: `/v3/services/image` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.729662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.731021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:10.739651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:10.740635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:10.741569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 346/697] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:10.742413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.767623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fc98-8daa-4385-8270-b635011cc412 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.800635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.801336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.801620 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.801900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/1a6424b0415b4383b7593ae57032d520/roles/b63e277927a74d40a291769119d60894` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.803807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=1a6424b0415b4383b7593ae57032d520, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.805296 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.818242 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 352/698] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:54:10 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/1a6424b0415b4383b7593ae57032d520/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:54:10.819020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.822211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.863810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e69ab-7c9a-4acd-8f9a-d9660ba1b320 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.902172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.903192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.903527 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.903866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.904511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:10.904810 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.906343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:10.916695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 347/699] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:10.916695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:10.943431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:10.947818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489983ba-c032-4e77-96c7-e9ae3538cbc6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:10.991124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:10.992329 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:10.992627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:10.992885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:10.993896 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] RBAC: Adding query filter params (name=image) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:10.996170 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:10.998134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.005948 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 353/700] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.006797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.036728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c47c9-9d10-4074-895c-19f9b19c8f33 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.072471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.073240 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.073517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.073784 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] PATH_INFO: `/v3/services/network` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.074367 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.075882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:11.085333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:11.091874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:11.093205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 348/701] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:10 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:11.094548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.094548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.125501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9fdf3-264d-4c90-a53b-d5f894d62220 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.159292 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.159904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.160186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.160459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.161136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.161441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.162818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.169054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 354/702] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.170048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.201817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09bd9-bcd7-4fec-8147-7049d0edc75f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.202852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.241264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.244549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.244549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.244549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.244549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] RBAC: Adding query filter params (type=image) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.244549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.245764 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.257489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 349/703] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.258991 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.284581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3c3c5-33cd-4f26-a452-d8d41932897b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.321532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.322067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.322343 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.322610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.323236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] RBAC: Adding query filter params (name=network) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.323540 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.324992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.330165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 355/704] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.330944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.339720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.378408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850489-0eac-44fc-8a48-440360915b76 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.413419 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.414377 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.415227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.415680 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.416921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] RBAC: Adding query filter params (interface=public, service_id=2af6903d54224237be44c2143462fe2e, region_id=RegionOne) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.417435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.419303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.427799 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 350/705] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/endpoints?service_id=2af6903d54224237be44c2143462fe2e&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.428848 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.435214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.446688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e594f1-c683-42db-90e2-2a82650a2388 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.480714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.481421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.481624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.481900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.482610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] RBAC: Adding query filter params (interface=public, service_id=db508ddc021740a893011c3c428c0ab7, region_id=RegionOne) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.482919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.484354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.491910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 356/706] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/endpoints?service_id=db508ddc021740a893011c3c428c0ab7&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.492527 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.541745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e9258-fa52-4cd1-987c-34b71c7e60d2 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.572640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.580994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.581593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.581875 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.582144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.582773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] RBAC: Adding query filter params (type=network) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.583103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.584433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.597249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 351/707] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.597249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.605864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102013f-a9a6-44c6-a3dc-a7e41b765fc4 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.641838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.642465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.642748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.643020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.643619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.645148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.650543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 357/708] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services => generated 1002 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:11.651468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.677267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.722020 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eca024-dcaf-415b-8687-8c4d593a03da None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.761973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.763150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.763631 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.764094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.765094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.767050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.774182 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 352/709] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services => generated 1002 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:11.775874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7add-0dde-4f21-9369-3d299cd6b83f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:11.822418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:11.823517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:11.824019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:11.824592 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:11.825638 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] RBAC: Adding query filter params (interface=public, service_id=8d8f632f981841bdab3d9617902e7d39, region_id=RegionOne) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:11.826163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:11.827866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e2df3-8ea2-426e-bbb2-53b24c019f51 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:11.834697 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 358/710] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/endpoints?service_id=8d8f632f981841bdab3d9617902e7d39&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:11.840171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:11.912503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:11.964343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df936-74bd-4dbb-bc05-cdc944ad8d7d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:12.001143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:12.001966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:12.002355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:12.002630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:12.003239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:12.004606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b045212-e878-44fd-ae61-8c73baf8ee0a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:12.010404 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 353/711] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:11 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:13.047301 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f73bd-e320-4497-a2e6-b9a85bd05815 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.047834 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f73bd-e320-4497-a2e6-b9a85bd05815 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.047834 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f73bd-e320-4497-a2e6-b9a85bd05815 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.049482 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 359/712] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:13.054956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.055392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.055567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.073920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:13.075103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:13.142358 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 354/713] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:13.473374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f73bd-e320-4497-a2e6-b9a85bd05815 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:13.563875 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:13.585645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f73bd-e320-4497-a2e6-b9a85bd05815 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:13.620977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:13.621664 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.621994 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.622270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.632815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:54:13.764758 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:13.765862 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:13.766719 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 360/714] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:13.773010 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:13.834121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:13.883029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d484c2-e2d2-4053-a25b-50363dbc66f4 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:13.918089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:13.918700 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.918977 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.919240 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.919899 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:13.920193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:13.921682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36d49-25de-4f90-a09e-34bb2de92cac None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:13.930538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 355/715] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:13.936399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:13.948107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36d1f-68e4-42e9-848d-5894773f37af None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.948759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36d1f-68e4-42e9-848d-5894773f37af None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.949086 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36d1f-68e4-42e9-848d-5894773f37af None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.951111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 356/716] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:13.955773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:13.956052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:13.956323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:13.978797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:13.979972 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:14.048726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746dae-d610-409b-8843-473ac48c8d2f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.063003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 357/717] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:14.086882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.087906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.088393 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.088851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.100058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.101951 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.104200 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-a0b52e29-1207-445f-9aab-4703f2f7c6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:14.119851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:14.120977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:14.121915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:14.121915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:14.121915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.124666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 361/718] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:14.130443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.180133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.182878 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ab9-e893-4280-9476-8e1705ee2199 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.183319 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ab9-e893-4280-9476-8e1705ee2199 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.183641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ab9-e893-4280-9476-8e1705ee2199 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.186115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 362/719] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:14.191318 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c559c-9a8c-460c-b1ef-1a778cc21462 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.191715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c559c-9a8c-460c-b1ef-1a778cc21462 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.192102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c559c-9a8c-460c-b1ef-1a778cc21462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.210383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-985c559c-9a8c-460c-b1ef-1a778cc21462 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:14.211692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-985c559c-9a8c-460c-b1ef-1a778cc21462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:14.243182 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2690-a314-4272-a5b1-9c35951b88f1 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.281352 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.282370 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.282895 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.283477 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.284402 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:14.284561 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 363/720] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:14.285034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.285985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312842b-bb1f-4f15-aeec-39d694e88106 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.286359 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312842b-bb1f-4f15-aeec-39d694e88106 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.286722 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312842b-bb1f-4f15-aeec-39d694e88106 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.287139 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.288390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 364/721] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:14.293123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941680d-70dd-441a-886f-670b17bec613 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.293408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941680d-70dd-441a-886f-670b17bec613 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.293692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941680d-70dd-441a-886f-670b17bec613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.300781 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 358/722] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:14.309891 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.312083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-f941680d-70dd-441a-886f-670b17bec613 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:14.313497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-f941680d-70dd-441a-886f-670b17bec613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:14.385252 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 365/723] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:14.418593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66ed89-2786-458f-80b1-fca086c12bcc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.446631 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941680d-70dd-441a-886f-670b17bec613 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.453665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.454523 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.455116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.455571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.456428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.465407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.467121 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:54:14.479026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:14.480032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 00:54:14.481022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:14.482343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 359/724] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:14.488136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.516306 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.578250 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941680d-70dd-441a-886f-670b17bec613 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.600170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01444cf6-14fd-4c3f-add6-ee7d3fba6c4f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.618691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.619803 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.620254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.620665 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.621431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.623366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:14.633128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:14.634163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.634999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 366/725] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:54:14.635804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.642689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.643571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.644019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.644458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.645388 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:14.645859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.647455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.665273 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 360/726] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:14.666363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.697311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.754342 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40d94-42dc-4a56-afc7-84e1b44ac924 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.771254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.788174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.788383 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14258cbe-c73a-493c-942e-69b163ab758e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.788832 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.789240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.789489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] PATH_INFO: `/v3/services/image` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.790150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.791703 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:14.801348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:14.802421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:14.803293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 367/727] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:14.804347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.825389 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.825993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.826269 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.826537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.827593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:14.827705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.829110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.833409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 361/728] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:14.834162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.902256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4370a22-06d9-4ea9-ae5a-ca3e4464131d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.916835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:14.933775 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d450931-4e24-4c66-be01-9e5a153f33ce None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:14.935829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.936537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.936820 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.937196 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.967565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:14.968317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:14.968593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:14.968864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] PATH_INFO: `/v3/services/network` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:14.969470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:14.970829 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:14.979196 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:14.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:14.981095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 362/729] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/services/network => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:14.981895 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:14.989738 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.009208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.010673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.087619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27a041-15eb-467f-8358-d6da00f3275e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.110496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 368/730] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 00:54:15.111326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.128255 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.128868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.129189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.129465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.130112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.130421 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.131803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.136299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 363/731] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.137100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.156404 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.196186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.214364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abbafc-457d-4eff-92f4-f516209cc50b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.242623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644934-64a2-4fad-bb8c-5fb4506e74e3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.255772 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.256424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.256700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.256998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.257626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.257927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.259278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.264138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 369/732] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.265499 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.283532 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.284144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.284423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.284696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.285361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] RBAC: Adding query filter params (name=network) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.285668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.287032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.292946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 364/733] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.294060 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.365611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1873b-f18b-4ee9-be04-cc8c693b2c4a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.374964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.399037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c701d-0b96-4652-997e-dbb3c77cce58 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.400780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.402111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.402111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.402111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.412094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.413598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.420257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:15.428934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:15.429940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:15.430866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:15.430866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:15.430866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:15.430866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 370/734] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:15.430866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.436478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.437127 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.437407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.437676 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.438299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] RBAC: Adding query filter params (type=image) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.438597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.439966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.446397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 365/735] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.447186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.536132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9e9f-88fb-48f1-b7e1-ad072ee44024 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.548297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c53fe-acc2-4494-9a75-e0fb7cc0eb65 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.572236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.572838 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.573160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.573426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.574074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.575445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.585187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.586487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.586797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.587190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.588252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.588741 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.591060 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.598900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 366/736] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.600084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.611098 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.616744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 371/737] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:15.617845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.684465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.715303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5ee42-c777-47a0-83b4-faa0d69b27e3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.749396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915882-94f8-4b31-a8dd-a99bedcd743c None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.754439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.755162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.755449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.755725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.756386 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:15.756688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.758136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.776319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 367/738] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:15.776319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.794959 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.795614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.796074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.796352 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.797208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.799071 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.823455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 372/739] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:15.824943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:15.854845 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.908233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7200c-f296-4f40-925a-67eddb4a5f41 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.960754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:15.961519 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:15.962075 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:15.962356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:15.963608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:15.965670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:15.970126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a7f4-724a-4e92-a542-e4fbd4475818 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:15.980425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:15.999644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 368/740] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:16.023994 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:16.024659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:16.024966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:16.025239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:16.033631 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:16.035147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:16.050079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:16.051225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:16.052180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:16.056152 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 373/741] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:16.058046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:16.179832 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd14d6a-2d15-4577-bc4d-6032f7e7bf6d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:16.202278 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:16.218677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:16.219332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:16.219604 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:16.219903 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:16.220644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:16.221001 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:16.222491 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457e478-660f-4ddd-88e1-c60dff39367d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:16.361178 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 369/742] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:16.367316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:16.477957 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995193b-c25b-43b9-956f-0bf8e097218f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:16.512469 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:16.513101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:16.513381 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:16.513658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:16.514378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=1a6424b0415b4383b7593ae57032d520) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:16.515097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:16.516554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b6a60-650c-400a-aff8-1b338b72b62c None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:16.522515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 374/743] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:54:16 2022] GET /identity/v3/role_assignments?user.id=1a6424b0415b4383b7593ae57032d520&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=b63e277927a74d40a291769119d60894 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:17.932629 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cc55-71d2-499b-b014-3381bd9e3842 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:17.933265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cc55-71d2-499b-b014-3381bd9e3842 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:17.933265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44cc55-71d2-499b-b014-3381bd9e3842 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:17.934476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 370/744] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:17.940441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089bc4-25e9-4e84-924a-296f4e07e1c4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:17.940926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089bc4-25e9-4e84-924a-296f4e07e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:17.941226 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089bc4-25e9-4e84-924a-296f4e07e1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:17.960526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-c3089bc4-25e9-4e84-924a-296f4e07e1c4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:17.961742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-c3089bc4-25e9-4e84-924a-296f4e07e1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:17.986473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:18.038714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 375/745] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:18.136759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234138c1-50cb-4ef0-9db2-1dbf22d0e649 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.137135 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234138c1-50cb-4ef0-9db2-1dbf22d0e649 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.137328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234138c1-50cb-4ef0-9db2-1dbf22d0e649 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.138813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 371/746] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:18.143946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.144221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.144519 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.164009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:18.165210 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:18.234093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 376/747] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:18.366366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234138c1-50cb-4ef0-9db2-1dbf22d0e649 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:18.478898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234138c1-50cb-4ef0-9db2-1dbf22d0e649 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:18.514861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:18.515542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.515817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.516084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.516654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:18.518032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:18.526586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:18.527576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:18.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:18.532686 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 372/748] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:18.533583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:18.566967 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:18.617732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:18.630725 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:18.645974 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac27d3-10bd-438f-8bad-7346989a11d1 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:18.676822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35c2b-a8b0-4a8c-9f8d-b7340ba3058f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:18.679837 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:18.680659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.681145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.681910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.682742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:18.683217 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:18.684767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:18.689941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 377/749] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:18.695532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:18.715606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:18.716214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.716487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.716750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.785389 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:18.786738 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:18.800922 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93b0f-d051-4f48-8a81-1e38dfef2ac2 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:18.840218 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:18.840595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:18.841264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.841607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.841890 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.842589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:18.842900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:18.844315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbe3fa-6393-4df5-ba9f-8dee969303e0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:18.849041 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 378/750] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:18.850034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09e6d-9520-4f86-9c55-0d356b692f92 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.850371 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09e6d-9520-4f86-9c55-0d356b692f92 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.850644 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09e6d-9520-4f86-9c55-0d356b692f92 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.851821 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 379/751] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:18.857672 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:18.857952 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:18.858851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:18.878978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:18.880218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:18.892663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:18.927914 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 373/752] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:54:18 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 00:54:18.934050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:18.970366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 380/753] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:19.046791 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36274-ad7a-4222-a771-69b6c246da15 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:19.082068 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:19.082700 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:19.082970 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:19.083238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:19.095180 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:19.096611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:19.098541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:54:19.114543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:19.115569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:54:19.116538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:54:19.116538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:54:19.116538 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:19.120989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 374/754] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:54:19.123104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:19.227022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7ecc-43cb-46b5-b80e-f5a9d9b49f15 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:19.262867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:19.263477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:19.263752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:19.264020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:19.264912 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:19.265228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:19.266595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:19.278128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 381/755] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:19.301822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:19.413578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ba1c4-bc01-4158-a6d2-7b8b8eb6f623 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:19.449708 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:19.450332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:19.450600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:19.450862 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:19.451438 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:19.453188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:19.462906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:19.463928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:19.464851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 375/756] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Aug 19 00:54:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:19.470246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:19.474164 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:19.575160 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f666-0653-4150-a2c4-7bf595a1cf8f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:19.614256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:19.615214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:19.615491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:19.615760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:19.616501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:19.616805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:19.618225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58e036-b18f-4d51-bd6a-a268f7ae7f0d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:19.623072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 382/757] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:19.628726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:19.696122 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:19.737613 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a5d8-42b1-470b-a401-bd634866e914 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:19.772077 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:19.772669 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:19.772977 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:19.773244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:19.773865 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:19.774167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:19.775516 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a0aa1-b6d6-4a73-8f77-51b2ed1cd158 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:19.780625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 376/758] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:21.038662 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386699-fe67-497c-894b-cb6913f9180f None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:21.039205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386699-fe67-497c-894b-cb6913f9180f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:21.039205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386699-fe67-497c-894b-cb6913f9180f None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:21.040506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 383/759] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:21.045845 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705dd6-717e-445f-944a-c5cf2006872e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:21.046300 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705dd6-717e-445f-944a-c5cf2006872e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:21.046393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705dd6-717e-445f-944a-c5cf2006872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:21.065285 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5b705dd6-717e-445f-944a-c5cf2006872e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:21.066471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5b705dd6-717e-445f-944a-c5cf2006872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:21.134181 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 377/760] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:21 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:21.463036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8386699-fe67-497c-894b-cb6913f9180f None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:21.537053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:21.572625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8386699-fe67-497c-894b-cb6913f9180f None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:21.606876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:21.607502 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:21.607762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:21.608153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:21.608737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:21.610030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9a27e-1337-45cd-b533-f71a6fe656eb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:21.632111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 384/761] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:21 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:22.002766 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfb6e-deb0-48b0-bdcf-892c5de0f5a3 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:22.003032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfb6e-deb0-48b0-bdcf-892c5de0f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:22.003286 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dfb6e-deb0-48b0-bdcf-892c5de0f5a3 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:22.004806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 378/762] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:22.010328 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2ab1-bd03-4ed0-91b5-6f38ad7f5cf4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:22.010716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2ab1-bd03-4ed0-91b5-6f38ad7f5cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:22.011057 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2ab1-bd03-4ed0-91b5-6f38ad7f5cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:22.030035 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-3d8c2ab1-bd03-4ed0-91b5-6f38ad7f5cf4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:22.031235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3d8c2ab1-bd03-4ed0-91b5-6f38ad7f5cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:22.106408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 385/763] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:22 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:22.437461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dfb6e-deb0-48b0-bdcf-892c5de0f5a3 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:22.492633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:22.538511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dfb6e-deb0-48b0-bdcf-892c5de0f5a3 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:22.573217 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:22.573800 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:22.574069 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:22.574315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:22.574973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:22.576354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707f971-3216-4844-b28b-3c860ba373f1 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:22.591961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 379/764] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:22 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:23.831650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09e6c-e62a-4c74-9089-498274677cbd None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:23.832208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09e6c-e62a-4c74-9089-498274677cbd None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:23.832364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09e6c-e62a-4c74-9089-498274677cbd None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:23.833688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 386/765] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:23.839868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:23.840295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:23.840434 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:23.865351 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:23.866545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:23.944032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 380/766] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:23 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:24.292127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a09e6c-e62a-4c74-9089-498274677cbd None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:24.353584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:24.404465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a09e6c-e62a-4c74-9089-498274677cbd None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:24.441485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:24.442125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.442399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.442666 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.443254 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:24.444637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:24.454426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:24.455613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:24.456545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 387/767] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:24.461641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:24.502552 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:24.563390 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4a94-f095-4556-99ae-c5431b944962 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:24.597421 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:24.598022 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.598295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.598522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.599177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:24.599472 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:24.600828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:24.605802 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 381/768] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:24.611573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:24.723550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba4c1-68dd-4826-b05e-1195455282af None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:24.740688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:24.759223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:24.759831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.760112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.760383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.761044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:24.761348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:24.762737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465f25-ad59-4670-b271-133b9afe2986 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:24.769183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 388/769] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:24.775296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:24.779033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060702-d2bd-468b-81fd-04d55bc03fa6 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.779370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060702-d2bd-468b-81fd-04d55bc03fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.779671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060702-d2bd-468b-81fd-04d55bc03fa6 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.781039 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 389/770] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:24.785998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.786302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.786575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.806326 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:24.807517 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:24.876475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 390/771] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:24.886576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447de8a-5d45-4d62-8a11-d1dcbe5749e7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:24.888222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:24.922767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:24.923377 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:24.923654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:24.923908 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:24.924593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] RBAC: Adding query filter params (interface=public, service_id=9faddd83030c41aca126adf1759c1f3b, region_id=RegionOne) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:24.924924 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:24.926341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:24.931742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 382/772] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:24 2022] GET /identity/v3/endpoints?service_id=9faddd83030c41aca126adf1759c1f3b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:24.937641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.037283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc27b5b-87b1-4216-9dc4-3ebaaf9c0ccd None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.051257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:25.074283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.074889 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.075168 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.075441 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.076047 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.077543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.083634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 391/773] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:24 2022] GET /identity/v3/services => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:25.203282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.313533 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd565-3d4f-4e64-9d0b-1e440dfe679e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.350955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.351624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.351900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.352165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.352748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.354210 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:25.364287 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:25.365297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:25.366215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 383/774] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Aug 19 00:54:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:25.371605 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.474929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0fc45-2905-4bec-a114-81cee6c41eb5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.510252 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.510885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.511169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.511455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.512148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:25.512509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.513980 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.518830 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 392/775] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:25.524777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.560288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:25.632194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902f730-fbb5-4aa0-bb92-c6230cb7b0a4 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.664870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.665496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.665770 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.666034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.666654 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:25.666935 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.668286 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.673343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 384/776] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:25.679632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.721941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:25.782513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0f06-87ba-4921-8070-f7fde395a455 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.818129 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.818797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.819074 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.819418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.820127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] RBAC: Adding query filter params (interface=public, service_id=6222b5b70bbb4ab790f51d5cfe294308, region_id=RegionOne) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:25.820435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.821848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f1c95-4d59-41f4-9150-2a7cbdb0cab0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.826925 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 393/777] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:25 2022] GET /identity/v3/endpoints?service_id=6222b5b70bbb4ab790f51d5cfe294308&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:25.832647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:25.931401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:25.938874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c450ee-9d66-4a03-9b05-d801eb707d7e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:25.972504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:25.973136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:25.973408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:25.973672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:25.974263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:25.975616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6fb6d-0102-4c2c-b3a1-ba5b12cdc805 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:25.981636 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 385/778] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:25 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:27.245151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f69f-a337-4e59-8f73-c4a2799a1d66 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:27.245711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f69f-a337-4e59-8f73-c4a2799a1d66 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:27.245711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f69f-a337-4e59-8f73-c4a2799a1d66 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:27.247176 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 394/779] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:27.252416 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:27.252872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:27.252998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:27.273094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:27.274303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:27.342866 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 386/780] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:27.664723 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838f69f-a337-4e59-8f73-c4a2799a1d66 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:27.771174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838f69f-a337-4e59-8f73-c4a2799a1d66 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:27.773579 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:27.808012 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:27.808641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:27.808920 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:27.809222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:27.809809 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:27.811231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:27.820120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:27.821199 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:27.822069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 395/781] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:27.827703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:27.918350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:27.932559 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831fb32-bf72-4743-acd9-b3f159548f7b None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:27.969679 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:27.970284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:27.970561 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:27.970830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:27.971460 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:27.971753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:27.973161 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:27.978119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 387/782] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:27.984183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:28.089221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c1dea-27c6-449d-9f25-3e5581388fcf None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:28.124032 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:28.124628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.124905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.125202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.125829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:28.126129 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:28.127495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8ede0-2e2c-4973-8dcd-cf6e9098697f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:28.132434 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 396/783] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Aug 19 00:54:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:28.138710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:28.223100 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1befe12-0104-4773-a9b2-fb090c81acce None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.223298 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1befe12-0104-4773-a9b2-fb090c81acce None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.223584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1befe12-0104-4773-a9b2-fb090c81acce None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.224930 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 397/784] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:28.230003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.230291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.230567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.248767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823937c5-a469-43e6-b182-04fae2ef8ae8 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:28.250676 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:28.252020 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:28.278591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:28.283784 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:28.284397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.284682 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.284990 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.285665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:28.287042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:28.308179 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 388/785] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:28.333670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 398/786] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:28.663542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:28.675307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:28.767400 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024aa63-c60e-4149-b0f0-f31557b9a2a0 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:28.801615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:28.802239 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.802507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.802774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.803346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:28.804695 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:28.813910 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:28.814854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:28.815750 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 389/787] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Aug 19 00:54:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:28.821004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:28.921896 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75e32e-4a87-4aa0-bad9-88ec904e8084 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:28.956060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:28.956663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:28.956947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:28.957240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:28.957866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:28.958161 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:28.959519 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:28.964251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 399/788] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:28.970653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:29.043039 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:29.073293 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eadfc-582f-4b4a-971e-e1e8b890e0cc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:29.107973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:29.108567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:29.108835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:29.109120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:29.109732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:29.110023 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:29.111366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124b6f4-a1a2-4626-828d-bbd6ca7bcf38 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:29.115914 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 390/789] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Aug 19 00:54:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:29.121986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:29.146776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:29.220587 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e056-d72b-4bb4-83be-7eb9c650d6cc None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:29.253974 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:29.254510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:29.254789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:29.255061 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:29.255776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:29.257228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ec111-3bc2-4354-88a2-2ab0c5249492 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:29.278658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 400/790] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 00:54:30.542193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033a95-40f8-4c1b-9143-79759ff20181 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:30.542735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033a95-40f8-4c1b-9143-79759ff20181 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:30.542735 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033a95-40f8-4c1b-9143-79759ff20181 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:30.544064 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 391/791] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:30.549769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:30.550238 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:30.550380 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:30.570564 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:30.571767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:30.650251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 401/792] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:30.977231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033a95-40f8-4c1b-9143-79759ff20181 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:31.086135 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033a95-40f8-4c1b-9143-79759ff20181 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:31.120299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:31.120909 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:31.121198 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:31.121462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:31.122097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:31.123579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:31.126170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING keystone.server.flask.common [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 00:54:31.130329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:31.146155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.sql.core [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 00:54:31.146155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 00:54:31.146155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [parameters: {'id': 'dc9df77c4c584ce39621b930371d0672', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 00:54:31.146155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc9df77c4c584ce39621b930371d0672.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc9df77c4c584ce39621b930371d0672. Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application conn.query(q) Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 00:54:31.162326 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application result.read() Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 00:54:31.163205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application next(self.gen) Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application yield resource Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application next(self.gen) Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise self.value Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application session.commit() Aug 19 00:54:31.164229 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self.session.flush() Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application compat.raise_( Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 00:54:31.165315 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 00:54:31.166277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application conn.query(q) Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application result.read() Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 00:54:31.167173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [parameters: {'id': 'dc9df77c4c584ce39621b930371d0672', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:31.168123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:31.168996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc9df77c4c584ce39621b930371d0672. Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:31.170159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 392/793] 10.222.0.78 () {60 vars in 1140 bytes} [Fri Aug 19 00:54:30 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:31.172395 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:31.173770 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:31.274489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd399-5ad5-410a-807a-ca37fba13d49 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:31.310624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:31.310899 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:31.311208 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:31.311479 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:31.318528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:31.320026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-6637ef55-50e5-47f1-b821-94ba3799de1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:54:31.332590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:31.333724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:31.334750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 402/794] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:31.340438 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:31.450083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bdd1f-6c08-4ec3-8825-5df7da4623be None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:31.484065 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:31.484666 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:31.484979 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:31.485245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:31.485907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:31.486207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:31.487841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:31.492066 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566b7c-203b-4d74-b04c-385e9f0fb312 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:31.492385 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566b7c-203b-4d74-b04c-385e9f0fb312 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:31.492667 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566b7c-203b-4d74-b04c-385e9f0fb312 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:31.494019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 403/795] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:31.499457 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:31.499718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:31.499991 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:31.509939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 393/796] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:31.518381 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:31.519676 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:31.583509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:31.592863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 404/797] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:54:31.920650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:31.975414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:32.027185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34bac-7231-466d-ad56-ba53f6faeddc None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:32.061565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:32.062183 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:32.062461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:32.062736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:32.063308 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:32.064674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:32.073368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:32.074371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:32.075222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:32.077347 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 394/798] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:32.080935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:32.188473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba641a9f-fe16-4fce-879a-6f979dd03bd3 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:32.225288 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:32.225900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:32.226183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:32.226454 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:32.227089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:32.227394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:32.228768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69d40-960d-4a72-945b-fb4e8ec2f3c2 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:32.233676 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 405/799] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:32.239500 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:32.347389 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeddac-00aa-4275-bf84-98d43cd4d93f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:32.366424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:32.389508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:32.390116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:32.390391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:32.390665 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:32.391298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:32.391600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:32.392993 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88476a-a8d6-435f-a62b-3d582aedda98 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:32.397801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 395/800] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:33.713512 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5b47-2858-4f53-b725-a63f3dc6a8e9 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:33.714097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5b47-2858-4f53-b725-a63f3dc6a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:33.714097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5b47-2858-4f53-b725-a63f3dc6a8e9 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:33.715358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 406/801] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:33.721043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:33.721458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:33.721570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:33.740628 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:33.742186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:33.810540 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 396/802] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:34.133752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa5b47-2858-4f53-b725-a63f3dc6a8e9 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:34.196083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:34.241319 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa5b47-2858-4f53-b725-a63f3dc6a8e9 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:34.278256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:34.279039 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:34.279336 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:34.279606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:34.280225 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:34.281727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:34.284253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING keystone.server.flask.common [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 00:54:34.297181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.sql.core [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 00:54:34.297181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 00:54:34.297181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [parameters: {'user_id': '760f590e871b4035a13946d1a6731cc5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 00:54:34.297181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application conn.query(q) Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application result.read() Aug 19 00:54:34.313448 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 00:54:34.314418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application next(self.gen) Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application yield resource Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application next(self.gen) Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise self.value Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application session.commit() Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 00:54:34.315367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self.session.flush() Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application compat.raise_( Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 00:54:34.316297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 00:54:34.317222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application conn.query(q) Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application result.read() Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 00:54:34.318063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [parameters: {'user_id': '760f590e871b4035a13946d1a6731cc5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:34.318893 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 00:54:34.319689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:34.320601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 407/803] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Aug 19 00:54:34 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:34.321024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:34.427357 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdff6b-d754-4548-bb52-86b8e2634eae None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:34.438479 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:34.461916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:34.462535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:34.462807 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:34.463070 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:34.470231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:34.471644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-e62d9d00-8cc4-4925-aacd-6ed2c4325130 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:54:34.482825 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:34.483793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:34.484754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 397/804] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:54:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:34.490083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:34.548167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465724e7-6f02-4f80-9811-6b8bf0fb41f0 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:34.548424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465724e7-6f02-4f80-9811-6b8bf0fb41f0 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:34.548694 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465724e7-6f02-4f80-9811-6b8bf0fb41f0 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:34.550320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 398/805] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:54:34.557466 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:34.557754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:34.558027 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:34.581811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:34.583159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:34.601911 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a1a8f-72b5-4ff9-97a8-25703653a887 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:34.623522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:34.639439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:34.640063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:34.640361 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:34.640637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:34.641374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:34.641726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:34.643358 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdca4c-31d1-4a77-a92a-64cba5e81f23 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:34.658425 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 399/806] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:34.682854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 408/807] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Aug 19 00:54:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:34.983378 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:35.094188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:35.099129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778e94-5122-4b69-bfea-3dd259906c70 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:35.140918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:35.141651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:35.141922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:35.142186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:35.142815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:35.144208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d252a0-c526-4f0f-a279-c98310ab58e6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:35.160172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 400/808] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:54:34 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:37.330462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70328b-e910-4e7b-bcbd-6dc894fa09e4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:37.331000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70328b-e910-4e7b-bcbd-6dc894fa09e4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:37.331000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70328b-e910-4e7b-bcbd-6dc894fa09e4 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:37.332347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 409/809] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:37.338401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:37.339084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:37.339174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:37.361623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:37.363600 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:37.449250 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 401/810] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:37 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:37.775660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70328b-e910-4e7b-bcbd-6dc894fa09e4 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:37.889635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70328b-e910-4e7b-bcbd-6dc894fa09e4 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:37.926720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:37.927338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:37.927618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:37.927887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:37.928460 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:37.929869 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:37.939496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:37.940572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:37.941600 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:54:37.945078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 410/811] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:37.947178 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:38.043189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:38.062745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f67365-c5d4-49a2-807c-691c576026a6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:38.096324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:38.096938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:38.097243 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:38.097508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:38.098120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:38.098411 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:38.099774 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:38.104530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 402/812] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:54:38.110463 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:38.168690 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:38.231843 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515b136-d7a8-4bec-a7c3-d3d6d9a350fb None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:38.278711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:38.279576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:38.279853 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:38.280142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:38.280750 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:38.281076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:38.282450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:38.287222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 411/813] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:38.296238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:38.406464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a8647-e1a2-45c8-97b4-f573c11fbe05 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:38.445071 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:38.445677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:38.445955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:38.446227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:38.446923 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] RBAC: Adding query filter params (interface=public, service_id=b5edd4276ef9461589473ccdcb3a3242, region_id=RegionOne) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:38.447224 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:38.448597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474ce8-150b-40a2-ad04-e90ac3b59937 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:38.453710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 403/814] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:54:38 2022] GET /identity/v3/endpoints?service_id=b5edd4276ef9461589473ccdcb3a3242&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:38.459721 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:38.568171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f822-4a77-4943-b829-94a776253214 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:38.577943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:38.608289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:38.608916 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:38.609205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:38.609477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:38.610075 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:38.611451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf12f0-cfad-4834-a4ab-9ad9b08059eb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:38.617616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 412/815] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:54:38 2022] GET /identity/v3/services => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:54:40.846232 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5d959-ced0-4ba6-922c-c9880162f5e0 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:40.846792 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5d959-ced0-4ba6-922c-c9880162f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:40.846792 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5d959-ced0-4ba6-922c-c9880162f5e0 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:40.848142 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 404/816] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:54:40.854485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:40.855211 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:40.855347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:40.875276 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:54:40.876804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:54:40.950527 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 413/817] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:54:40 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:54:41.287632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5d959-ced0-4ba6-922c-c9880162f5e0 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:41.303917 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:41.399667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5d959-ced0-4ba6-922c-c9880162f5e0 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:41.436494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:41.437202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:41.437528 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:41.437803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:41.438461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:41.439881 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:54:41.448635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:54:41.449782 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:54:41.450767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 405/818] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:54:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:54:41.456206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:41.559049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:41.562185 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f17855-1485-4272-a5cb-aa5551a4907f None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:41.599701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:41.600299 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:41.600576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:41.600836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:41.601479 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:41.601779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:41.603138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:41.608399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 414/819] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:41.617743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:41.712201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:41.736397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8bd16-a2ae-44cd-8983-b582a49d6d53 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:41.770964 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:41.771555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:41.771830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:41.772096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:41.772715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:54:41.773046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:41.774393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad60f-72fd-432d-8cd1-6da058c8e5a7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:41.779734 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 406/820] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Aug 19 00:54:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:54:41.789700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:54:41.894257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc97cee-6618-49bd-b7ab-fbdbc1d72589 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:54:41.929477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:54:41.930382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:54:41.930657 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:54:41.930922 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:54:41.931566 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:54:41.932934 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2eb3-5ffe-4761-9c60-22cdbe623af8 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:54:41.955341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 415/821] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:54:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:54:51.776745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=29 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:54:51.950890 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:44.565050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a0be-000f-4755-912f-4c43a06ad868 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:44.565691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a0be-000f-4755-912f-4c43a06ad868 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:44.565691 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a0be-000f-4755-912f-4c43a06ad868 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:44.566997 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 407/822] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:55:44.573370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:44.573866 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:44.573975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:44.600144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:55:44.601532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:55:44.696541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 416/823] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:55:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:55:45.028273 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a0be-000f-4755-912f-4c43a06ad868 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:45.167124 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a0be-000f-4755-912f-4c43a06ad868 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:45.205786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:45.206920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:45.207274 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:45.207583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:45.220024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:45.221868 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:45.238617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:45.239860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:45.240842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:45.240842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:45.240842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:45.240842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 408/824] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:45.246807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:45.375286 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5438-4498-4a9c-ab90-c70c8ad1dec4 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:45.407641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:45.420627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:45.421421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:45.421713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:45.422011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:45.422674 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:45.422975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:45.424601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f266da-00f9-4018-a931-e07954eb2990 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:45.439637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 417/825] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:45.446323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:45.508670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:45.565709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcac3-1d43-42c6-baca-de9ad4972bd3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:45.606900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:45.607756 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:45.608040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:45.608343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:45.609265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:45.611036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f03b2-a4e7-4bd0-82f8-b48a3a83a272 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:45.641244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 409/826] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Aug 19 00:55:45 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:55:48.130676 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6de8-b85e-4db1-9a69-758b302527d6 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:48.131228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6de8-b85e-4db1-9a69-758b302527d6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:48.131354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee6de8-b85e-4db1-9a69-758b302527d6 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:48.132926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 418/827] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:55:48.138407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:48.138872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:48.138973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:48.159127 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:55:48.160433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:55:48.236468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 410/828] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:55:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:55:48.618111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee6de8-b85e-4db1-9a69-758b302527d6 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:48.736458 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee6de8-b85e-4db1-9a69-758b302527d6 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:48.774987 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:48.775628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:48.775910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:48.776183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:48.787252 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:55:48.792350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:48.793624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:48.794570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 419/829] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:55:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:48.799804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:48.849057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:48.918742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb520-0ae7-4f9a-b2a6-9a95ce4b73df None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:48.957713 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:48.958462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:48.958745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:48.959021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:48.959729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:48.960118 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:48.961920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:48.971244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 411/830] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:48.978106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:49.028351 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:49.091780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa1cd-54b5-45f9-b314-4b3aa2e8bfc1 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:49.130770 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:49.131413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:49.131701 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:49.131977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:49.144542 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:49.146415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:49.163468 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:49.164632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:49.165593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:49.165593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:49.165593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:49.165593 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 420/831] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:49.171366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:49.282988 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:49.285984 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe8a3-7a1b-4b8a-b33e-787a3f71b1a8 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:49.323254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:49.323916 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:49.324212 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:49.324554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:49.325306 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:49.325601 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:49.327254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:49.342731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 412/832] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:55:49.348678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:49.459506 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:49.464141 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5471-fd2f-434e-b21e-042dfa1e7ea6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:49.501465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:49.502111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:49.502386 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:49.502670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:49.511765 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:49.513273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:55:49.525274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:49.526533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:49.527728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 421/833] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:49.532564 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:49.640857 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2f7e-89b3-448d-94ca-949239f96a16 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:49.678633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:49.679906 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:49.680170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:49.680420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:49.681193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:49.681497 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:49.682915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:49.700920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 413/834] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:55:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:49.707013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:49.831447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f994c7-80d4-42bd-80ec-24f7f4d4e027 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:49.871355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:49.873656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:49.873656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:49.873656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:49.906833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:49.953044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:49.954502 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.069066 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 422/835] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:55:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 00:55:50.074087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:50.095093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:50.187055 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fea4b-5d4c-4508-b19e-0e3f457a5078 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:50.224843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:50.225535 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:50.225818 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:50.226423 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:50.236361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:50.237851 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:50.255056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:50.256154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:50.262543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:50.262543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:50.262543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:50.262543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 414/836] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:50.263265 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:50.329085 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:50.374373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693bb4-044a-40cc-8fb0-2b4b6b72f40f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:50.417034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:50.417989 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:50.418226 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:50.418499 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:50.419156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:50.419450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:50.421001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.436049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 423/837] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:50.441840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:50.519514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:50.554084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729bc1a-3415-47c8-beb0-66c16998904b None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:50.591725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:50.592705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:50.593099 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:50.593312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:50.600346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:50.602505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:55:50.613856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:50.614811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:50.616048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 415/838] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:50.621521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:50.728314 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e64e-1a18-4a15-9997-c9363d5658b9 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:50.747153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:50.766280 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:50.767153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:50.767269 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:50.767537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:50.768240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:50.768541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:50.770028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9840bd-59b3-4a1d-bcd4-eefaa964900e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.782886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 424/839] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:55:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:55:50.789221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:50.915397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea02790-19a1-4c43-835a-6dfca1ca1419 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:50.949328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:50.956737 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:50.957478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:50.957823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:50.958106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:50.958924 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a6465174c65748dcbefbf791e42c8e22) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:50.959232 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:50.960876 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a94b-6c06-43da-8fe4-b526ebda89b6 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:50.967498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 416/840] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:55:50 2022] GET /identity/v3/role_assignments?user.id=a6465174c65748dcbefbf791e42c8e22&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:53.142726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07200-491f-41af-bdb1-80ee90abe078 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:53.143312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07200-491f-41af-bdb1-80ee90abe078 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:53.143312 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07200-491f-41af-bdb1-80ee90abe078 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:53.144650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 425/841] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:55:53.151477 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:53.151897 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:53.152140 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:53.173965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:55:53.175237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:55:53.254233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 417/842] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:55:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:55:53.609464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07200-491f-41af-bdb1-80ee90abe078 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:53.717691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07200-491f-41af-bdb1-80ee90abe078 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:53.756477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:53.757239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:53.757549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:53.757820 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:53.768484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:55:53.773309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:53.774926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:53.776663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 426/843] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:53.781651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:53.902783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea165a-8e7c-4ddf-9751-cef3e3cbc7b2 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:53.929578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:53.942223 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:53.943281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:53.943716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:53.944186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:53.945177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:53.945476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:53.947275 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:53.956651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 418/844] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:55:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:53.963738 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:54.008309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:54.072979 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f425a-3d0b-46eb-88f8-e87ad5248192 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:54.117530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:54.118354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:54.118733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:54.119049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:54.130274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:54.131762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:54.147347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:54.149658 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:54.150975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:54.150975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:54.150975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:54.153127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 427/845] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:54.155329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:54.289619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3297-c1fd-4c89-81c2-10637c6695cb None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:54.327920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:54.328529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:54.328806 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:54.329111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:54.329743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:54.330057 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:54.331755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:54.346325 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 419/846] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:54.352182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:54.452026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:54.463236 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdada9-6a37-45f4-a82c-dd9d7641e6d5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:54.504831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:54.505545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:54.505826 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:54.506131 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:54.514762 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:54.516206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:55:54.528493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:54.529777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:54.530998 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 428/847] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:54.535794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:54.586727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:54.651739 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49453-fa48-42d0-a001-ab65307308d9 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:54.693546 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:54.694153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:54.694433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:54.694748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:54.695473 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:54.695776 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:54.697231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:54.716597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 420/848] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:55:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:55:54.722291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:54.840350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98313a-3075-4c69-9788-0ac2a3827106 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:54.875675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:54.876310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:54.876589 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:54.876859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:54.889481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:54.890972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:54.905717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:54.911864 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:54.912882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:54.912882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:54.912882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:54.912882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 429/849] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:54.913288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:55.030979 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ac147-060b-480f-949a-db0d04f91262 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:55.033475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:55.067193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:55.068116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:55.068391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:55.068662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:55.069351 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:55.069759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:55.071672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:55.083215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 421/850] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:55:55.089533 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:55.092530 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:55.209463 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f63a8-8f91-4124-989f-bfc3c5c4213e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:55.245891 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:55.246579 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:55.247050 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:55.247521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:55.255598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:55.257547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:55:55.271218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:55.272348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:55:55.278029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 430/851] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:55.279013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:55.387901 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f81131-3383-4fd8-b193-0ddc64c75005 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:55.426934 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:55.427778 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:55.428067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:55.428366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:55.429454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:55.429937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:55.431724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff886-4cf8-409d-97bd-6b31a1215102 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:55.446031 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 422/852] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:55.452596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:55.525483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:55.574552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e30-2821-46bc-81d9-8355424f4e5d None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:55.611700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:55.612371 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:55.612731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:55.613056 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a6465174c65748dcbefbf791e42c8e22/roles/33f19ac7355d4ff5bfd925e8c8140a99` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:55.631814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=a6465174c65748dcbefbf791e42c8e22, role_id=33f19ac7355d4ff5bfd925e8c8140a99)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:55.634077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873e8f1-2b7b-4ebf-a4f1-223c50e51ccd None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:55.649743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 431/853] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:55:55 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a6465174c65748dcbefbf791e42c8e22/roles/33f19ac7355d4ff5bfd925e8c8140a99 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 00:55:58.047904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd5d4-4f2a-418e-9d0e-b3cc8c255804 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:58.048554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd5d4-4f2a-418e-9d0e-b3cc8c255804 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:58.048554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd5d4-4f2a-418e-9d0e-b3cc8c255804 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:58.049950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 423/854] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:55:58.056414 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:58.056867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:58.057001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:58.077725 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:55:58.078874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:55:58.152366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 432/855] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:55:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 00:55:58.514472 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd5d4-4f2a-418e-9d0e-b3cc8c255804 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:58.546885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:58.641725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd5d4-4f2a-418e-9d0e-b3cc8c255804 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:58.680999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:58.681726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:58.682089 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:58.682397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:58.694231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:55:58.699688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:58.700980 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:58.702035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 424/856] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Aug 19 00:55:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:58.710937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:58.757721 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:58.824253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c097-03ac-4335-b292-3825fe1fcb2f None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:58.867953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:58.868663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:58.868978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:58.869302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:58.870077 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:58.870434 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:58.871985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:58.881473 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 433/857] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Aug 19 00:55:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:58.888265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:58.983688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:59.001951 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4bf94-9fb8-4c0b-aecc-2e9de5ae1e1d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:59.042222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:59.042859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:59.043139 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:59.043411 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:59.056002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:59.058162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:55:59.078128 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:59.079385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:55:59.080395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:55:59.080395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:55:59.080395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:59.080395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 425/858] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:59.086759 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:59.200030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e222db8-627d-43f8-9761-cb2509e771d0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:59.203469 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:59.244132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:59.245156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:59.245633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:59.246097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:59.247198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:59.247568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:59.249421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:59.264672 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 434/859] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:55:59.271101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:59.391795 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b257dde-457c-4f6a-bc64-3dd15a60d718 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:59.428427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:59.429376 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:59.429812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:59.429921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:59.433206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:59.438974 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:59.440610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:55:59.453233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:55:59.454398 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:55:59.455840 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 426/860] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:55:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:55:59.460730 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:59.580413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc65b6-ece0-42c7-a94c-b2fedc96f6a3 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:59.615973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:59.616683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:59.617131 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:59.617675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:59.618549 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:55:59.618853 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:59.620677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:59.643153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 435/861] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:55:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:55:59.649172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:55:59.757525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11daf-ce9d-4f73-a02a-1f7c546d7c18 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:55:59.797808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:55:59.798451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:55:59.798867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:55:59.799197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:55:59.880827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:55:59.889050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:55:59.890512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:55:59.997323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 427/862] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:55:59 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 00:56:00.003397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:00.031006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:00.119465 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687a8f6-caa2-46a1-8fd0-d4beb301dfca None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:00.160716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:00.161562 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:00.161846 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:00.162207 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:00.174884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:00.177169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:00.196004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:00.197123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:00.198038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:00.198038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:00.198038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:00.198038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 436/863] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:56:00.203926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:00.307534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:00.314757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffe783-85b1-45d1-9deb-f9224fb70808 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:00.353896 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:00.354529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:00.354925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:00.355309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:00.355958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:00.356258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:00.357647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:00.370111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 428/864] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:00.375904 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:00.460373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:00.486353 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e1f6-f2d8-4ee3-b259-f4e3c9bbc503 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:00.527015 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:00.527700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:00.528047 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:00.528418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:00.537970 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:00.539733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:56:00.551737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:00.553062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:00.554623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 437/865] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 00:56:00.559753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:00.674936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f49e4-2fa5-400b-aa08-d19ea7f4686e None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:00.717299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:00.717963 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:00.718221 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:00.718545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:00.719430 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:00.719707 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:00.721577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a18da-8eb5-4637-af74-e681115f6abd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:00.741678 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 429/866] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:00.742896 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:00.862205 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3202-2860-452d-aa92-f376a3bc2cf6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:00.898887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:00.899302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:00.899576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:00.899968 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:00.900978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] RBAC: Adding query filter params (role.id=33f19ac7355d4ff5bfd925e8c8140a99, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a6465174c65748dcbefbf791e42c8e22) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:00.901304 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:00.903246 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356f257-0ab9-4952-b588-e0c587f80d0f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:00.905338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:00.912491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 438/867] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:56:00 2022] GET /identity/v3/role_assignments?user.id=a6465174c65748dcbefbf791e42c8e22&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=33f19ac7355d4ff5bfd925e8c8140a99 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:03.415921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb662c4-0d46-4267-9373-10264f64ae79 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:03.416726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb662c4-0d46-4267-9373-10264f64ae79 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:03.416726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb662c4-0d46-4267-9373-10264f64ae79 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:03.418391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 430/868] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:03.424611 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:03.425139 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:03.425230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:03.447253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:03.449057 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:03.542807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 439/869] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:03.918207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb662c4-0d46-4267-9373-10264f64ae79 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:03.938597 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:04.050555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb662c4-0d46-4267-9373-10264f64ae79 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.093783 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.094465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.094863 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.095231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.108432 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:56:04.114526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:04.115670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:04.116647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 431/870] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:04.122664 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:04.233259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c278cb6-2726-40d9-91a5-0acc97f0f2af None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.261588 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:04.270116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.270798 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.271119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.271484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.272207 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:04.272569 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:04.274443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:04.283599 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 440/871] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:56:04.290382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:04.373602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:04.400189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1232-ef62-4db5-8c20-c172f397ff77 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.438401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.439150 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.439262 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.439530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.450815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:04.452437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:04.468913 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:04.470097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:04.471194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:04.471194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:04.471194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:04.471194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 432/872] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:04.476118 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:04.584253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66926-b7be-4094-8099-626e1eab30a6 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.618713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.619309 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.619588 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.619886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.620514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:04.620814 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:04.622255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:04.635297 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 441/873] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:04.641427 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:04.749798 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed9ae-091c-43c9-852f-f5229338989d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.778536 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:04.787027 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.787664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.787934 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.788205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.796743 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:04.798381 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:56:04.812724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:04.813937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:04.820220 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 433/874] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:04.822774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:04.896725 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:04.952116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b433a-960a-4e48-8bb2-fe29f3b871ac None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:04.989112 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:04.989706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:04.989985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:04.990257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:04.991058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:04.991364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:04.992908 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:05.012184 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 442/875] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:56:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:05.017458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:05.137606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3729da-2551-4ec6-a76e-1d07ccde4f33 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:05.175489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:05.176028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:05.176306 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:05.176587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:05.235263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:05.250794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:05.252279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:05.369162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 434/876] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:56:05 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 00:56:05.375426 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:05.497513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641edef-5484-4464-96e8-af838f5bec00 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:05.508138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:05.539515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:05.540177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:05.540422 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:05.540686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:05.552413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:05.554090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:05.575492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:05.576573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:05.577683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:05.577683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:05.577683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:05.577683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 443/877] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:05.582873 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:05.679827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:05.694355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731f93-a01a-4bcf-a538-29bdcf3271ba None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:05.730065 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:05.730683 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:05.730961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:05.731227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:05.731874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:05.732175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:05.733593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:05.746108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 435/878] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:05.752294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:05.875450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7806a8-08ff-4f29-b0ac-0e5454723d10 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:05.912233 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:05.912867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:05.913202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:05.913474 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:05.920447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:05.922051 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:56:05.942195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:05.943294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:05.944390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:05.947256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 444/879] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:05.955376 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:06.061067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89fb6a-0f61-4d03-8292-ebc35dc0e3c3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:06.095170 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:06.095768 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:06.096040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:06.096306 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:06.097030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:06.097331 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:06.098742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8751f0-0e04-4e55-bb83-8b5d4c90019a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:06.110627 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 436/880] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:06.116728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:06.139668 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:06.221093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfe4a6-8000-4af6-ba36-f8a042129521 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:06.261213 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:06.261826 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:06.262132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:06.262400 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:06.263120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a6465174c65748dcbefbf791e42c8e22) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:06.263425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:06.264857 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f842e-f704-400a-b005-d5b4b6bb7d04 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:06.270577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 445/881] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:56:06 2022] GET /identity/v3/role_assignments?user.id=a6465174c65748dcbefbf791e42c8e22&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=b63e277927a74d40a291769119d60894 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:08.442244 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469e41-2f5d-4f16-9b13-0857d5abd479 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:08.443072 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469e41-2f5d-4f16-9b13-0857d5abd479 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:08.443072 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469e41-2f5d-4f16-9b13-0857d5abd479 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:08.445401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 437/882] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:08.451431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:08.451881 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:08.451973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:08.480537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:08.481749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:08.564855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 446/883] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:08.907534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469e41-2f5d-4f16-9b13-0857d5abd479 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:08.919653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.045281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469e41-2f5d-4f16-9b13-0857d5abd479 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.083264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.083885 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.084163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.084434 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.095002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:56:09.099586 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:09.100723 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:09.101971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 438/884] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:09.109158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:09.128835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.219675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0fafb-62ad-4d94-bbe5-6911b9d9dd19 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.256976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.257627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.257995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.258268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.258947 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:09.259267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:09.260627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:09.269030 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 447/885] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:09.276507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:09.359024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.392833 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e205b5-b40f-4295-ad47-8aa4d8606e44 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.428543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.429187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.429457 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.429970 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.440865 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:09.442331 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:09.459448 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:09.460699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:09.462435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:09.462435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:09.462435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:09.462435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 439/886] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:09.470221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:09.562141 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.586651 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e4f9-e22d-4575-a58c-6bc01ab03783 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.622476 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.623085 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.623369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.623644 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.624261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:09.624585 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:09.626005 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:09.637526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 448/887] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:09.643630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:09.755136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b72527-b5ac-4da9-bd92-2b88519ef3ea None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.774850 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.791340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.791958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.792230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.792494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.801362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:09.803233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:56:09.814542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:09.815706 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:09.816670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 440/888] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:09.822518 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:09.931422 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d37c3-728b-4e59-b91b-fd655eab600b None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:09.966935 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:09.967541 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:09.967819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:09.968094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:09.968810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:09.969147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:09.970590 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:09.973197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:09.989419 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 449/889] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 00:56:09.995460 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:10.096869 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b5fe6-cc6d-4a1c-ad98-a387d2385d3f None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:10.131749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:10.132350 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:10.132623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:10.133000 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:10.143503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:10.144935 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:10.158965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:10.160005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:10.161252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:10.161252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:10.161252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:10.161252 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 441/890] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:10.166595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:10.293369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88b902-4283-4463-be45-77af71961e7e None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:10.341300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:10.341907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:10.342191 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:10.342463 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:10.343103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:10.343407 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:10.344785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:10.356835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 450/891] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:10.366235 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:10.400280 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:10.483016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369f36-f3e5-4ede-a027-24d4a1080541 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:10.520019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:10.520623 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:10.520936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:10.521197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:10.528140 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:10.529606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:56:10.540471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:10.546483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:10.547578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 442/892] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:10.548181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:10.609767 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:10.660734 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f326790-85b2-4717-becd-b00a1bdb00a0 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:10.703500 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:10.704101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:10.704389 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:10.704656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:10.705399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:10.705708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:10.707121 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9842b12-4d72-403b-966c-932f91d1cea3 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:10.719316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 451/893] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:10.725992 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:10.825700 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:10.837136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9d41-af13-441f-b0e4-89f0f925dca3 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:10.874495 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:10.875074 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:10.875354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:10.875631 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] PATH_INFO: `/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a6465174c65748dcbefbf791e42c8e22/roles/b63e277927a74d40a291769119d60894` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:10.877701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=edb418136fcb4bcb843d91af3ad17b37, user_id=a6465174c65748dcbefbf791e42c8e22, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:10.879129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01656-25aa-41c9-a6a8-a4f5340de2a5 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:10.896373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 443/894] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Aug 19 00:56:10 2022] PUT /identity/v3/projects/edb418136fcb4bcb843d91af3ad17b37/users/a6465174c65748dcbefbf791e42c8e22/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 00:56:13.010413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc68c-d4b8-4d0c-9b42-0e9b2070d501 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:13.011281 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc68c-d4b8-4d0c-9b42-0e9b2070d501 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:13.011416 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc68c-d4b8-4d0c-9b42-0e9b2070d501 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:13.013639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 452/895] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:13.022490 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:13.023212 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:13.023390 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:13.049346 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:13.050529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:13.122509 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 444/896] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:13.445873 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cc68c-d4b8-4d0c-9b42-0e9b2070d501 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:13.561444 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cc68c-d4b8-4d0c-9b42-0e9b2070d501 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:13.577349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:13.598905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:13.599521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:13.599790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:13.600055 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:13.610795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 00:56:13.615445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:13.616514 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:13.617648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 453/897] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Aug 19 00:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:13.622719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:13.717754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:13.737739 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780848-f0e5-4cb7-9f3f-b3c1f1100521 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:13.772053 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:13.772651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:13.772936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:13.773255 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:13.774172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:13.774582 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:13.775951 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:13.783738 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 445/898] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Aug 19 00:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:13.792054 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:13.916576 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82066e3-5b94-48ed-b9eb-75e9ccb39c88 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:13.954539 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:13.955163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:13.955440 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:13.955718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:13.966331 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:13.967828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:13.982622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:13.983778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:13.984969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:13.984969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:13.984969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:13.984969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 454/899] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:13.991599 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:14.098070 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6025a1-93e3-469b-9572-15d641ba3c8c None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:14.132912 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:14.133544 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:14.133820 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:14.134083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:14.134709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:14.135003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:14.136361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:14.147545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 446/900] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:14.154308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:14.194341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:14.277212 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f8bdf-0f0b-4a09-847a-fe9600c0d9a7 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:14.312863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:14.313462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:14.313768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:14.314036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:14.322154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:14.323596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 00:56:14.334833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:14.335915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:14.337591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 455/901] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:14.344804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:14.351050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:14.458637 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d634-f62e-48b3-be7f-17b010412195 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:14.494407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:14.494998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:14.495275 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:14.495549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:14.496267 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:14.496565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:14.498012 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:14.515047 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 447/902] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Aug 19 00:56:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:14.521167 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:14.623143 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:14.639943 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad2b3e-587f-40b1-8187-e9f680da1b37 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:14.673818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:14.674413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:14.674689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:14.674957 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:14.749845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:14.751273 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:14.840006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:14.858100 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 456/903] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Aug 19 00:56:14 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 00:56:14.864081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:14.928405 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:14.968500 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c241a6d-f7ba-4487-9e39-1250572404e7 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:15.002392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:15.003003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:15.003272 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:15.003533 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:15.013611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:15.015040 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 00:56:15.029407 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:15.030512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 00:56:15.031675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 00:56:15.031675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 00:56:15.031675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:15.031675 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 448/904] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 00:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:15.037153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:15.148237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f46a-37c7-4c61-840f-40115629234f None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:15.183522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:15.184119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:15.184374 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:15.184641 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:15.185307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:15.185604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:15.186976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:15.198373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 457/905] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Aug 19 00:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:15.204966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:15.311297 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4afee8-5cd3-4b96-a5f4-77bbcea1fb5d None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:15.326543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:15.357264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:15.357883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:15.358160 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:15.358424 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:15.365725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:15.367159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 00:56:15.385451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:15.386437 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: ERROR keystone.server.flask.application Aug 19 00:56:15.387355 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 449/906] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Aug 19 00:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:15.392850 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:15.450891 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:15.507325 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55679-e4d0-4e76-9c02-b641d22218d5 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:15.542680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:15.543276 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:15.543554 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:15.543828 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:15.544516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:15.544819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:15.546291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db1bf-f641-4982-8bf7-cc9e5fc03862 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:15.558964 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 458/907] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Aug 19 00:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:15.565245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:15.702377 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647d45-ce31-42ec-a38d-6432d6680589 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:15.741245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:15.741843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:15.742119 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:15.742436 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:15.743218 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] RBAC: Adding query filter params (role.id=b63e277927a74d40a291769119d60894, scope.project.id=edb418136fcb4bcb843d91af3ad17b37, user.id=a6465174c65748dcbefbf791e42c8e22) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:15.743522 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:15.744938 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe671be-57b5-495a-8ef6-ded07e84de3a None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:15.750827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 450/908] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Aug 19 00:56:15 2022] GET /identity/v3/role_assignments?user.id=a6465174c65748dcbefbf791e42c8e22&scope.project.id=edb418136fcb4bcb843d91af3ad17b37&role.id=b63e277927a74d40a291769119d60894 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:17.955570 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555f6d-8939-40cf-83ab-9f01cc2b79aa None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:17.956163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555f6d-8939-40cf-83ab-9f01cc2b79aa None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:17.956163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3555f6d-8939-40cf-83ab-9f01cc2b79aa None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:17.957501 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 459/909] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:17.963911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:17.964655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:17.964853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:17.994403 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:17.995595 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:18.029697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:18.078298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 451/910] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:18.393364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3555f6d-8939-40cf-83ab-9f01cc2b79aa None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:18.505543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3555f6d-8939-40cf-83ab-9f01cc2b79aa None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:18.513218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:18.543070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:18.543687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:18.543960 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:18.544227 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:18.544798 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:18.546179 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:18.555382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:18.556439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:18.557768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 460/911] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Aug 19 00:56:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:18.563193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:18.671647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4952db-939e-4bcf-99af-207848e8f42c None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:18.710534 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:18.711129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:18.711532 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:18.712001 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:18.713115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:18.713561 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:18.714921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d277b27-eed3-46f2-bd97-6c333d52257d None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:18.719914 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 452/912] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Aug 19 00:56:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:18.725956 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:18.845230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78d9a-ef48-4566-8bbb-4d2c2ccdb825 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:18.883743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:18.884561 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:18.885015 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:18.885500 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] PATH_INFO: `/v3/services` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:18.886547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:18.886880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:18.888728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cf59-b636-49d2-b07c-e5f3b8fbc099 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:18.894966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 461/913] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Aug 19 00:56:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:21.046968 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e300-f7f1-43f5-8657-faf1323af8e6 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:21.047815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e300-f7f1-43f5-8657-faf1323af8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:21.047815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e300-f7f1-43f5-8657-faf1323af8e6 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:21.049940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 453/914] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:21.058566 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d871-c7f8-41a8-be1f-c204707d9412 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:21.058992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d871-c7f8-41a8-be1f-c204707d9412 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:21.059138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d871-c7f8-41a8-be1f-c204707d9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:21.087564 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b1c2d871-c7f8-41a8-be1f-c204707d9412 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:21.088774 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b1c2d871-c7f8-41a8-be1f-c204707d9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:21.119124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:21.170290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 462/915] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:21.490225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e300-f7f1-43f5-8657-faf1323af8e6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:21.528571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:21.612166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e300-f7f1-43f5-8657-faf1323af8e6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:21.657205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:21.657804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:21.658077 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:21.658373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:21.659043 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:21.660416 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a864-6e8d-4c32-9cd8-c60163d6c9bf None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:21.679303 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 454/916] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Aug 19 00:56:21 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:56:23.892150 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce951-df0c-4232-bc50-51fdaee06587 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:23.892706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce951-df0c-4232-bc50-51fdaee06587 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:23.892706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce951-df0c-4232-bc50-51fdaee06587 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:23.894107 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 463/917] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:23.900361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:23.901103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:23.901258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:23.931801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:23.932999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:24.013730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 455/918] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:23 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:24.344423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce951-df0c-4232-bc50-51fdaee06587 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:24.460174 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce951-df0c-4232-bc50-51fdaee06587 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:24.495835 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:24.496484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:24.496756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:24.497168 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:24.497724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:24.499079 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:24.507827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:24.509059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:24.510158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 464/919] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Aug 19 00:56:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:24.515912 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:24.543655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:24.630928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013b757-d667-4411-a1f4-9b791c0d43ac None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:24.668921 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:24.669542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:24.669818 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:24.670090 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:24.670717 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:24.671019 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:24.672387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:24.677769 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 456/920] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Aug 19 00:56:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:24.684515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:24.716836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:24.807972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89afac9-b1e4-44e7-8326-717b6c845a02 None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:24.843733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:24.844333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:24.844614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:24.844886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:24.845622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] RBAC: Adding query filter params (interface=public, service_id=05a6a73e6ae048bb960b407f4201ff8d, region_id=RegionOne) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:24.845931 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:24.847300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f634ec-10ef-4550-8dcb-9233cc46b1bb None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:24.852993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 465/921] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Aug 19 00:56:24 2022] GET /identity/v3/endpoints?service_id=05a6a73e6ae048bb960b407f4201ff8d&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:24.859817 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:24.954020 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:24.974845 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19113b2d-5482-4ca3-a09b-905878effc36 None admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:25.010334 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:25.010929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:25.011202 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:25.011471 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:25.012065 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:25.013467 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18917f21-f797-4b10-90a9-ba7c22fb7ccd None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:25.023763 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 457/922] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Aug 19 00:56:24 2022] GET /identity/v3/services => generated 1962 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 00:56:27.169661 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9fb0-e15f-43ae-a4ed-4935c1ea99eb None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:27.170536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9fb0-e15f-43ae-a4ed-4935c1ea99eb None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:27.170536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec9fb0-e15f-43ae-a4ed-4935c1ea99eb None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:27.172735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 466/923] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:56:27.182042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:27.182467 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:27.182640 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:27.206151 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:56:27.207343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:56:27.284815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 458/924] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:56:27 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 00:56:27.605384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9fb0-e15f-43ae-a4ed-4935c1ea99eb None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:27.705148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:27.721394 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec9fb0-e15f-43ae-a4ed-4935c1ea99eb None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:27.764139 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:27.764790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:27.765086 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:27.765356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:27.765936 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:27.767327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 00:56:27.776680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 00:56:27.777907 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application with Lock( Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self._enter() Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application return self.creator() Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application created_value = creator( Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: ERROR keystone.server.flask.application Aug 19 00:56:27.778791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 467/925] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Aug 19 00:56:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 00:56:27.784720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:27.875945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:27.901581 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852833-de14-43ca-8416-48e0c262ab0f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:27.935983 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:27.936575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:27.936853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:27.937159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] PATH_INFO: `/v3/services` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:27.937779 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 00:56:27.938074 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:27.939443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4be0b0-d724-4e07-b84f-6055e00552d7 None admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:27.944428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 459/926] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Aug 19 00:56:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 00:56:27.950528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:56:28.057825 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38bca6-5d99-4477-9377-bd1416687b8a None admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:56:28.095919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:56:28.096510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:56:28.096788 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:56:28.097127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:56:28.097795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:56:28.099161 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceee6a-9bcf-4550-91a0-82b6d963e841 None admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:56:28.123137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 468/927] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 00:56:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 00:56:37.941531 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=30 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:56:38.117681 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:57:29.638918 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbbc4-4d2c-43ef-8aa7-5d7df2b0cf3e None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:29.639450 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbbc4-4d2c-43ef-8aa7-5d7df2b0cf3e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:29.639450 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbbc4-4d2c-43ef-8aa7-5d7df2b0cf3e None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:29.641028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 460/928] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:29.646103 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e9b5-cb32-40c0-8a0d-61f43ca30ab8 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:29.646547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e9b5-cb32-40c0-8a0d-61f43ca30ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:29.646627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e9b5-cb32-40c0-8a0d-61f43ca30ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:29.666354 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1178e9b5-cb32-40c0-8a0d-61f43ca30ab8 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:29.667591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1178e9b5-cb32-40c0-8a0d-61f43ca30ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:29.743839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 469/929] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:30.098576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98e47-0b17-4306-9335-3f81d885cc7a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:30.098576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98e47-0b17-4306-9335-3f81d885cc7a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:30.098576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde98e47-0b17-4306-9335-3f81d885cc7a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:30.100720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 461/930] 10.222.0.78 () {54 vars in 965 bytes} [Fri Aug 19 00:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:30.108318 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f148e8-4bbc-4fed-b441-aefcfe0878f7 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:30.108867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f148e8-4bbc-4fed-b441-aefcfe0878f7 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:30.109262 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f148e8-4bbc-4fed-b441-aefcfe0878f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:30.171788 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d6f148e8-4bbc-4fed-b441-aefcfe0878f7 None None] MFA Rules not processed for user `dd7abf396926447ea82b5c2215e9124f`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:30.173547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d6f148e8-4bbc-4fed-b441-aefcfe0878f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:30.251162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 470/931] 10.222.0.78 () {58 vars in 1062 bytes} [Fri Aug 19 00:57:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:30.260786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98e47-0b17-4306-9335-3f81d885cc7a None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:30.273208 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde98e47-0b17-4306-9335-3f81d885cc7a None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:30.276722 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:30.277358 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:30.277634 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:30.277905 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:30.287158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:30.288580 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b587a9-1b98-4f0a-8410-4f340f821d31 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:30.298409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 462/932] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:32.758487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef9c4-3628-4712-a22d-546377567f10 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:32.759060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef9c4-3628-4712-a22d-546377567f10 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:32.759060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef9c4-3628-4712-a22d-546377567f10 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:32.761523 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 471/933] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:32.767129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd563e-7920-42c6-8c70-77e393e687ad None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:32.767648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd563e-7920-42c6-8c70-77e393e687ad None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:32.767739 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd563e-7920-42c6-8c70-77e393e687ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:32.788404 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-dbcd563e-7920-42c6-8c70-77e393e687ad None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:32.789677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-dbcd563e-7920-42c6-8c70-77e393e687ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:32.800602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 463/934] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:33.155851 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a6fd-49f8-4cee-abfd-589f9fbeb40a None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:33.156202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a6fd-49f8-4cee-abfd-589f9fbeb40a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:33.156406 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a6fd-49f8-4cee-abfd-589f9fbeb40a None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:33.157927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 472/935] 10.222.0.78 () {54 vars in 965 bytes} [Fri Aug 19 00:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:33.163685 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eec00-909f-41f0-a073-f3757f09b1ea None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:33.164078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eec00-909f-41f0-a073-f3757f09b1ea None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:33.164453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eec00-909f-41f0-a073-f3757f09b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:33.185395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-c89eec00-909f-41f0-a073-f3757f09b1ea None None] MFA Rules not processed for user `dd7abf396926447ea82b5c2215e9124f`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:33.186724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-c89eec00-909f-41f0-a073-f3757f09b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:33.193617 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 464/936] 10.222.0.78 () {58 vars in 1062 bytes} [Fri Aug 19 00:57:33 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:33.202627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a6fd-49f8-4cee-abfd-589f9fbeb40a None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:33.214255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a6fd-49f8-4cee-abfd-589f9fbeb40a None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:33.218106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:33.218714 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:33.218993 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:33.219263 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:33.228974 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:33.230421 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e9bb-2032-4452-be6e-07b173afe1c7 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:33.240609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 473/937] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:35.980510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef00fa-dc64-4c87-a7e4-5abf4a610481 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:35.981093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef00fa-dc64-4c87-a7e4-5abf4a610481 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:35.981093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef00fa-dc64-4c87-a7e4-5abf4a610481 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:35.982575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 465/938] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 00:57:35.987756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6985-c2bf-43f3-a863-197de5b47644 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:35.988209 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6985-c2bf-43f3-a863-197de5b47644 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:35.988300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6985-c2bf-43f3-a863-197de5b47644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:36.027288 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-711a6985-c2bf-43f3-a863-197de5b47644 None None] MFA Rules not processed for user `8f650ea91a9048b092d3250b32193f17`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:36.028485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-711a6985-c2bf-43f3-a863-197de5b47644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:36.070335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:57:36.097878 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 474/939] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:35 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:36.435702 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef00fa-dc64-4c87-a7e4-5abf4a610481 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:36.449349 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef00fa-dc64-4c87-a7e4-5abf4a610481 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:36.453602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:36.454222 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:36.454494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:36.454760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:36.465362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:36.467192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6216e-48f7-414d-ad19-5846d0139c5a service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:36.478251 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 466/940] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:36 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:39.277557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ff8a-466f-43b0-8d90-bfaee5ffe2c0 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:39.278076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ff8a-466f-43b0-8d90-bfaee5ffe2c0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:39.278180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ff8a-466f-43b0-8d90-bfaee5ffe2c0 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:39.280163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 475/941] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:39.288563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad6ce-2129-47b2-af95-9c2d36ca8fbf None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:39.288982 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad6ce-2129-47b2-af95-9c2d36ca8fbf None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:39.289190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad6ce-2129-47b2-af95-9c2d36ca8fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:39.311301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-892ad6ce-2129-47b2-af95-9c2d36ca8fbf None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:39.312502 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-892ad6ce-2129-47b2-af95-9c2d36ca8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:39.397110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 467/942] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:39 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:39.744045 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ff8a-466f-43b0-8d90-bfaee5ffe2c0 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:39.756612 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ff8a-466f-43b0-8d90-bfaee5ffe2c0 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:39.760521 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:39.761154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:39.761439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:39.761718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:39.771607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:39.773078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbdda6-ffdf-4907-9cb2-bd033f676c5c service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:39.783411 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 476/943] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:42.649891 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b566f-fe9d-47fb-8ffa-e1727bfdd9b4 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:42.650443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b566f-fe9d-47fb-8ffa-e1727bfdd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:42.650443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b566f-fe9d-47fb-8ffa-e1727bfdd9b4 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:42.651929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 468/944] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:42.657356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef8a8-7a50-4d17-a646-d43242680be4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:42.657791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef8a8-7a50-4d17-a646-d43242680be4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:42.657882 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef8a8-7a50-4d17-a646-d43242680be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:42.677163 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1caef8a8-7a50-4d17-a646-d43242680be4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:42.678335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1caef8a8-7a50-4d17-a646-d43242680be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:42.688232 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 477/945] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:43.028281 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b566f-fe9d-47fb-8ffa-e1727bfdd9b4 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:43.039476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b566f-fe9d-47fb-8ffa-e1727bfdd9b4 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:43.043459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:43.044056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:43.044335 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:43.044610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:43.053855 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:43.055324 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca49d0-d5ab-4bbb-8a8b-193c6aa52f54 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:43.065449 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 469/946] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:45.280856 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897874-774d-495a-9024-107e40c4a02f None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:45.281376 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897874-774d-495a-9024-107e40c4a02f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:45.281376 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897874-774d-495a-9024-107e40c4a02f None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:45.282927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 478/947] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:45.288111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881549-eec9-4754-8af7-cb2d6d17c65c None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:45.288547 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881549-eec9-4754-8af7-cb2d6d17c65c None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:45.288641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881549-eec9-4754-8af7-cb2d6d17c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:45.310730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-78881549-eec9-4754-8af7-cb2d6d17c65c None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:45.311932 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-78881549-eec9-4754-8af7-cb2d6d17c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:45.321397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 470/948] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:45.657348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897874-774d-495a-9024-107e40c4a02f None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:45.668695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897874-774d-495a-9024-107e40c4a02f None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:45.672504 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:45.673144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:45.673385 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:45.673675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:45.683865 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:45.685337 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc0b7-639b-4f92-a2c5-664737d83f80 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:45.695134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 479/949] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:47.893115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cded-afa9-44ac-89a7-b2c92022b443 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:47.893602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cded-afa9-44ac-89a7-b2c92022b443 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:47.893700 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3cded-afa9-44ac-89a7-b2c92022b443 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:47.895217 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 471/950] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:47.902578 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01e95-14dc-4e31-91b0-6a72d24bd740 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:47.903026 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01e95-14dc-4e31-91b0-6a72d24bd740 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:47.903138 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01e95-14dc-4e31-91b0-6a72d24bd740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:47.922906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-bac01e95-14dc-4e31-91b0-6a72d24bd740 None None] MFA Rules not processed for user `8f650ea91a9048b092d3250b32193f17`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:47.924111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-bac01e95-14dc-4e31-91b0-6a72d24bd740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:47.933128 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 480/951] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:47 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:48.273512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3cded-afa9-44ac-89a7-b2c92022b443 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:48.284862 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3cded-afa9-44ac-89a7-b2c92022b443 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:48.288439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:48.289070 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:48.289348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:48.289619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:48.299351 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:48.300787 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c3c20-eda7-45e6-8964-13584c0cded3 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:48.310895 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 472/952] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:48 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:50.771865 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf71c-6cee-439f-9bfd-a88f3be7853a None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:50.772390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf71c-6cee-439f-9bfd-a88f3be7853a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:50.772390 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf71c-6cee-439f-9bfd-a88f3be7853a None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:50.773745 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 481/953] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:50.779663 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0be5-b824-41cd-8163-19f813784755 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:50.780115 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0be5-b824-41cd-8163-19f813784755 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:50.780329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0be5-b824-41cd-8163-19f813784755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:50.800858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-6c8c0be5-b824-41cd-8163-19f813784755 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:50.802132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-6c8c0be5-b824-41cd-8163-19f813784755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:50.810900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 473/954] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:51.160418 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf71c-6cee-439f-9bfd-a88f3be7853a None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:51.172453 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf71c-6cee-439f-9bfd-a88f3be7853a None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:51.176510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:51.177145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:51.177462 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:51.177768 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:51.188779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:51.190330 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37235b3-883a-4822-82be-f0cc471ce43c service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:51.201019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 482/955] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:53.426295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182954c-8df0-4fd4-af0a-e67a67e09842 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:53.426797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182954c-8df0-4fd4-af0a-e67a67e09842 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:53.426797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182954c-8df0-4fd4-af0a-e67a67e09842 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:53.428130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 474/956] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:53.434403 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f05a-8143-4770-9bcf-2461151b17b0 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:53.434913 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f05a-8143-4770-9bcf-2461151b17b0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:53.435014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f05a-8143-4770-9bcf-2461151b17b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:53.455744 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-5aa3f05a-8143-4770-9bcf-2461151b17b0 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:53.456958 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5aa3f05a-8143-4770-9bcf-2461151b17b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:53.466941 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 483/957] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:53.801753 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182954c-8df0-4fd4-af0a-e67a67e09842 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:53.813845 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182954c-8df0-4fd4-af0a-e67a67e09842 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:53.817822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:53.818494 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:53.818836 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:53.819147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:53.829588 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:53.831014 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2979a-b265-41ce-9e1a-580509ffc471 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:53.840867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 475/958] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:57:56.342721 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc552883-70de-4c32-99fd-f708260dbf63 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:56.343275 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc552883-70de-4c32-99fd-f708260dbf63 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:56.343275 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc552883-70de-4c32-99fd-f708260dbf63 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:56.344797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 484/959] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:57:56.351813 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce0fe-90e5-4c0d-9810-fa4bf33992a4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:56.352504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce0fe-90e5-4c0d-9810-fa4bf33992a4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:56.352624 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce0fe-90e5-4c0d-9810-fa4bf33992a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:56.379055 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-54cce0fe-90e5-4c0d-9810-fa4bf33992a4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:57:56.380328 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-54cce0fe-90e5-4c0d-9810-fa4bf33992a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:57:56.394663 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 476/960] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:57:56 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:57:56.735125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc552883-70de-4c32-99fd-f708260dbf63 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:57:56.761464 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc552883-70de-4c32-99fd-f708260dbf63 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:57:56.766619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:57:56.767290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:57:56.767613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:57:56.767905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:57:56.778973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:57:56.780413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2608e9f-f124-4fe5-aa1c-d789bd34ca85 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:57:56.790665 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 485/961] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:57:56 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:00.908615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171298-a97b-4130-b1a8-d827d1072600 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:00.909200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171298-a97b-4130-b1a8-d827d1072600 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:00.909200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171298-a97b-4130-b1a8-d827d1072600 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:00.910444 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 477/962] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:00.916033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226314-13cd-4094-8984-532a68092a04 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:00.916478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226314-13cd-4094-8984-532a68092a04 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:00.917084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226314-13cd-4094-8984-532a68092a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:00.938124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-23226314-13cd-4094-8984-532a68092a04 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:00.939223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-23226314-13cd-4094-8984-532a68092a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:00.947341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 486/963] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:01.285879 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171298-a97b-4130-b1a8-d827d1072600 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:01.292106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=77 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:01.299359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171298-a97b-4130-b1a8-d827d1072600 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:01.302992 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:01.303593 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:01.303872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:01.304143 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:01.314052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:01.315501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d2d27-9c23-4e89-a1e5-2246add902c1 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:01.325175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 478/964] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:04.199223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecc5c-70a4-44b6-9ecf-531775ed10c4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:04.199783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecc5c-70a4-44b6-9ecf-531775ed10c4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:04.199783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ecc5c-70a4-44b6-9ecf-531775ed10c4 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:04.201147 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 487/965] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:04.206709 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbabd-7295-4f15-a6f8-6d278375c54f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:04.207190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbabd-7295-4f15-a6f8-6d278375c54f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:04.207288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbabd-7295-4f15-a6f8-6d278375c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:04.226550 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-330bbabd-7295-4f15-a6f8-6d278375c54f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:04.227732 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-330bbabd-7295-4f15-a6f8-6d278375c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:04.236037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 479/966] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:04 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:58:04.576494 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ecc5c-70a4-44b6-9ecf-531775ed10c4 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:04.590290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ecc5c-70a4-44b6-9ecf-531775ed10c4 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:04.599335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:04.599954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:04.600233 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:04.600510 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:04.610271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:04.611702 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9829c-fe8c-460f-86f7-3508d5f93661 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:04.621574 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 488/967] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:08.901384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8690-f034-4446-96a4-7432a456868e None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:08.901926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8690-f034-4446-96a4-7432a456868e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:08.901926 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8690-f034-4446-96a4-7432a456868e None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:08.903390 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 480/968] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:08.909013 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614b98-e02b-4d5e-bc0b-f22519ef037b None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:08.909430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614b98-e02b-4d5e-bc0b-f22519ef037b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:08.909696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614b98-e02b-4d5e-bc0b-f22519ef037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:08.917999 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=54 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:08.933080 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-70614b98-e02b-4d5e-bc0b-f22519ef037b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:08.934311 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-70614b98-e02b-4d5e-bc0b-f22519ef037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:08.943833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 489/969] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:09.299233 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8690-f034-4446-96a4-7432a456868e None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:09.311050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8690-f034-4446-96a4-7432a456868e None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:09.315056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:09.315716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:09.315986 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:09.316273 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:09.325905 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:09.327382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a9198-0ba4-4e22-bdbf-d87fb9bf3e59 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:09.337230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 481/970] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:14.742836 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abe11-47ef-4818-8832-810e66569625 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:14.743944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abe11-47ef-4818-8832-810e66569625 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:14.744444 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1abe11-47ef-4818-8832-810e66569625 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:14.746786 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 490/971] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 00:58:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:14.752318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8416-5051-4aba-8578-7b4385f0acb7 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:14.753122 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8416-5051-4aba-8578-7b4385f0acb7 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:14.753554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff8416-5051-4aba-8578-7b4385f0acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:14.805359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-80ff8416-5051-4aba-8578-7b4385f0acb7 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:14.807262 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-80ff8416-5051-4aba-8578-7b4385f0acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:14.933401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 482/972] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 00:58:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:58:18.927221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=2 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:19.501657 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae14-3782-40f3-bb73-a631237312f2 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:19.502097 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae14-3782-40f3-bb73-a631237312f2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:19.502492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae14-3782-40f3-bb73-a631237312f2 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:19.504291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 491/973] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 00:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:19.509382 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02914-e08a-4f77-a82e-ce6f76384578 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:19.509839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02914-e08a-4f77-a82e-ce6f76384578 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:19.510037 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02914-e08a-4f77-a82e-ce6f76384578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:19.531660 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-afc02914-e08a-4f77-a82e-ce6f76384578 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:19.533188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-afc02914-e08a-4f77-a82e-ce6f76384578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:19.541956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 483/974] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 00:58:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:20.972495 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0970-d19d-4249-9661-2033d52af7ae None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:20.973104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0970-d19d-4249-9661-2033d52af7ae None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:20.973104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0970-d19d-4249-9661-2033d52af7ae None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:20.974523 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 492/975] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:20.979662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92256d-6545-4c68-b79d-210aeb48093a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:20.980112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92256d-6545-4c68-b79d-210aeb48093a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:20.980215 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92256d-6545-4c68-b79d-210aeb48093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:21.000625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fc92256d-6545-4c68-b79d-210aeb48093a None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:21.001944 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fc92256d-6545-4c68-b79d-210aeb48093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:21.011205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 484/976] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 00:58:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:25.041155 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398eb8-b3ed-4349-9089-37b9d0a7312b None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:25.041761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398eb8-b3ed-4349-9089-37b9d0a7312b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:25.041843 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398eb8-b3ed-4349-9089-37b9d0a7312b None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:25.043162 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 493/977] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:25.048907 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0046ba-d6b1-473d-a19b-3361ed488d2a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:25.049359 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0046ba-d6b1-473d-a19b-3361ed488d2a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:25.049444 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0046ba-d6b1-473d-a19b-3361ed488d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:25.074985 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-ca0046ba-d6b1-473d-a19b-3361ed488d2a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:25.077015 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-ca0046ba-d6b1-473d-a19b-3361ed488d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:25.099049 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 485/978] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:25.441038 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971c0b-9e21-49b9-ad0f-b950b6980c04 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:25.442101 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971c0b-9e21-49b9-ad0f-b950b6980c04 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:25.442754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971c0b-9e21-49b9-ad0f-b950b6980c04 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:25.444675 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 494/979] 10.222.0.78 () {54 vars in 962 bytes} [Fri Aug 19 00:58:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:25.452539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74661-60c2-4afb-9641-7f873a267550 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:25.453266 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74661-60c2-4afb-9641-7f873a267550 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:25.453922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74661-60c2-4afb-9641-7f873a267550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:25.496461 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-b7a74661-60c2-4afb-9641-7f873a267550 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:25.498014 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-b7a74661-60c2-4afb-9641-7f873a267550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:25.576794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:25.589169 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 486/980] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Aug 19 00:58:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:58:25.591303 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971c0b-9e21-49b9-ad0f-b950b6980c04 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:25.607144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971c0b-9e21-49b9-ad0f-b950b6980c04 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:25.613053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:25.613790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:25.614169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:25.614558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:25.624727 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:25.626511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9929e3f-1015-48ce-9e5b-5ff0d62073bd service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:25.637180 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 495/981] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:28.022389 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6462a-b547-4b92-8bab-1e04cbdc52bb None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:28.022999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6462a-b547-4b92-8bab-1e04cbdc52bb None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:28.022999 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6462a-b547-4b92-8bab-1e04cbdc52bb None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:28.024248 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 487/982] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:28.030451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625727db-2550-406c-ab40-ab4bbb76b47a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:28.030927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625727db-2550-406c-ab40-ab4bbb76b47a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:28.031029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625727db-2550-406c-ab40-ab4bbb76b47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:28.051043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-625727db-2550-406c-ab40-ab4bbb76b47a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:28.052513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-625727db-2550-406c-ab40-ab4bbb76b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:28.062047 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 496/983] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:28.430482 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6462a-b547-4b92-8bab-1e04cbdc52bb None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:28.445844 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6462a-b547-4b92-8bab-1e04cbdc52bb None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:28.451694 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:28.452484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:28.452876 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:28.453272 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:28.462004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:28.464331 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2d7e-8b4d-45c4-8bed-323a574c9063 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:28.474507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 488/984] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:31.071606 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf482c-ca91-4790-8e1e-1a3725675e09 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:31.072102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf482c-ca91-4790-8e1e-1a3725675e09 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:31.072102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf482c-ca91-4790-8e1e-1a3725675e09 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:31.073607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 497/985] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:31.079044 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67bb2-6853-46aa-8e13-6fe78141562a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:31.079489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67bb2-6853-46aa-8e13-6fe78141562a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:31.079598 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67bb2-6853-46aa-8e13-6fe78141562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:31.101159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-3eb67bb2-6853-46aa-8e13-6fe78141562a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:31.102371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-3eb67bb2-6853-46aa-8e13-6fe78141562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:31.110488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 489/986] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:31.469732 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e13a-7538-41c9-a954-e7bf50802741 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:31.470121 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e13a-7538-41c9-a954-e7bf50802741 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:31.470401 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e13a-7538-41c9-a954-e7bf50802741 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:31.471746 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 498/987] 10.222.0.78 () {54 vars in 962 bytes} [Fri Aug 19 00:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:31.478607 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80210cb-1fa0-4392-8976-c0fbc817a6e1 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:31.479052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80210cb-1fa0-4392-8976-c0fbc817a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:31.479433 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80210cb-1fa0-4392-8976-c0fbc817a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:31.505721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-d80210cb-1fa0-4392-8976-c0fbc817a6e1 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:31.507551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-d80210cb-1fa0-4392-8976-c0fbc817a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:31.518231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 490/988] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Aug 19 00:58:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:31.528383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e13a-7538-41c9-a954-e7bf50802741 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:31.548407 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e13a-7538-41c9-a954-e7bf50802741 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:31.554399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:31.555228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:31.555601 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:31.555978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:31.565673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:31.567259 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf8070-16a5-4d0a-956c-5cfd3cb61b5d service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:31.577076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 499/989] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 00:58:33.892949 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e147dc-7b2b-4b6d-a348-7b40e2abf5b6 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:33.893488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e147dc-7b2b-4b6d-a348-7b40e2abf5b6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:33.893488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e147dc-7b2b-4b6d-a348-7b40e2abf5b6 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:33.894814 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 491/990] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:33.900333 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b111a-ed3a-4115-860c-1fbde449db03 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:33.901321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b111a-ed3a-4115-860c-1fbde449db03 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:33.901809 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b111a-ed3a-4115-860c-1fbde449db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:33.922892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-767b111a-ed3a-4115-860c-1fbde449db03 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:33.924485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-767b111a-ed3a-4115-860c-1fbde449db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:33.941347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 500/991] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:34.300592 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e147dc-7b2b-4b6d-a348-7b40e2abf5b6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:34.316560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e147dc-7b2b-4b6d-a348-7b40e2abf5b6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:34.321815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:34.322677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:34.323204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:34.323677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:34.332567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:34.334443 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b18777-b5ab-4417-ae40-6c279b08c3d9 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:34.357852 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 492/992] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:35.247316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1734d-b4c5-4939-ac0e-1cab083e55fb None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:35.247741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1734d-b4c5-4939-ac0e-1cab083e55fb None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:35.247965 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1734d-b4c5-4939-ac0e-1cab083e55fb None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:35.255313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9d9e-0e7e-4ead-b518-54ab2140156e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:35.255699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9d9e-0e7e-4ead-b518-54ab2140156e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:35.255941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9d9e-0e7e-4ead-b518-54ab2140156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:35.262804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 501/993] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:35 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:35.283211 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-787a9d9e-0e7e-4ead-b518-54ab2140156e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:35.284645 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-787a9d9e-0e7e-4ead-b518-54ab2140156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:35.295051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 493/994] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:35.863186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc648a-4a4d-46a0-8c73-6d685cbf6559 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:35.863429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc648a-4a4d-46a0-8c73-6d685cbf6559 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:35.863708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc648a-4a4d-46a0-8c73-6d685cbf6559 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:35.865340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 502/995] 10.222.0.78 () {54 vars in 964 bytes} [Fri Aug 19 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:35.870872 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251564a-c92e-4c6e-a517-e7433f8ee7d6 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:35.871167 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251564a-c92e-4c6e-a517-e7433f8ee7d6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:35.871414 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251564a-c92e-4c6e-a517-e7433f8ee7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:35.909186 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-7251564a-c92e-4c6e-a517-e7433f8ee7d6 None None] MFA Rules not processed for user `a4e4a153fdc34de3ae75b098acbb165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:35.910363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-7251564a-c92e-4c6e-a517-e7433f8ee7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:35.971268 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 494/996] 10.222.0.78 () {58 vars in 1061 bytes} [Fri Aug 19 00:58:35 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:35.978602 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc648a-4a4d-46a0-8c73-6d685cbf6559 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:35.990010 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc648a-4a4d-46a0-8c73-6d685cbf6559 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:35.994557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:35.995435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:35.995915 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:35.996383 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:36.007176 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:36.008940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf7fca-b466-4232-9065-25730e2e639b service cinder] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:36.020597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 503/997] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:36.697032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dc1b-c335-40fb-a465-05c895756dbf None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:36.697602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dc1b-c335-40fb-a465-05c895756dbf None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:36.697602 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2dc1b-c335-40fb-a465-05c895756dbf None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:36.699184 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 495/998] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:36.705459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4baec-144a-4c78-8f95-0248d93f4067 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:36.706049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4baec-144a-4c78-8f95-0248d93f4067 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:36.706049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4baec-144a-4c78-8f95-0248d93f4067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:36.726810 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-4bf4baec-144a-4c78-8f95-0248d93f4067 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:36.728044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-4bf4baec-144a-4c78-8f95-0248d93f4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:36.737235 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 504/999] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:37.098261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2dc1b-c335-40fb-a465-05c895756dbf None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:37.120641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2dc1b-c335-40fb-a465-05c895756dbf None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:37.127068 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:37.128017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:37.128453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:37.128811 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:37.141130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:37.144560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8e661-56a8-4d0f-b644-409e8fe660ad service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:37.170183 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 496/1000] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:39.371805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab785-8c5e-410d-8644-9bae660dceec None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:39.372740 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab785-8c5e-410d-8644-9bae660dceec None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:39.373238 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab785-8c5e-410d-8644-9bae660dceec None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:39.374785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 505/1001] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:39.380318 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5633d9-5f01-4c9e-b2d5-e10f93098973 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:39.380794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5633d9-5f01-4c9e-b2d5-e10f93098973 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:39.380948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5633d9-5f01-4c9e-b2d5-e10f93098973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:39.413990 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-2e5633d9-5f01-4c9e-b2d5-e10f93098973 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:39.415204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-2e5633d9-5f01-4c9e-b2d5-e10f93098973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:39.424003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 497/1002] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:39.768480 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab785-8c5e-410d-8644-9bae660dceec None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:39.790808 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab785-8c5e-410d-8644-9bae660dceec None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:39.796201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:39.796816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:39.797148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:39.797420 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:39.805995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:39.807877 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b193e-82fb-4259-8395-9be7c68d8343 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:39.817485 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 506/1003] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:42.090277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad14c-d9a5-4fa1-a92f-9138773ed72d None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:42.090809 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad14c-d9a5-4fa1-a92f-9138773ed72d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:42.090809 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad14c-d9a5-4fa1-a92f-9138773ed72d None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:42.092371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 498/1004] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:42.098171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21295-c53d-437c-9bef-3b8e83846e24 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:42.098670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21295-c53d-437c-9bef-3b8e83846e24 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:42.098752 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21295-c53d-437c-9bef-3b8e83846e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:42.118503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-04e21295-c53d-437c-9bef-3b8e83846e24 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:42.119880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-04e21295-c53d-437c-9bef-3b8e83846e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:42.128218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 507/1005] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:42.472183 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad14c-d9a5-4fa1-a92f-9138773ed72d None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:42.487744 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad14c-d9a5-4fa1-a92f-9138773ed72d None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:42.493263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:42.494154 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:42.494485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:42.494751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:42.503785 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:42.505440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053eb4-3d89-430a-a7f5-ae1274740dfb service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:42.515462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 499/1006] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:44.799815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b021c-a3de-4e18-a366-e3c0d7159419 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:44.800567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b021c-a3de-4e18-a366-e3c0d7159419 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:44.800567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b021c-a3de-4e18-a366-e3c0d7159419 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:44.801906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 508/1007] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:44.807928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6ece-eca8-4c69-8ecf-d0dc81c826a4 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:44.808805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6ece-eca8-4c69-8ecf-d0dc81c826a4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:44.808805 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6ece-eca8-4c69-8ecf-d0dc81c826a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:44.829096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-32cc6ece-eca8-4c69-8ecf-d0dc81c826a4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:44.830242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-32cc6ece-eca8-4c69-8ecf-d0dc81c826a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:44.839017 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 500/1008] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:45.209789 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b021c-a3de-4e18-a366-e3c0d7159419 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:45.226986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b021c-a3de-4e18-a366-e3c0d7159419 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:45.234584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:45.235204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:45.235483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:45.235754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:45.245455 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:45.247255 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21671031-957a-4039-a7bf-6c7bce3b7911 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:45.257816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 509/1009] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:47.980201 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a234b-cd6d-4fe8-ad5b-6d8a485f29fd None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:47.980978 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a234b-cd6d-4fe8-ad5b-6d8a485f29fd None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:47.981114 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a234b-cd6d-4fe8-ad5b-6d8a485f29fd None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:47.982749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 501/1010] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:47.991596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb696-2514-4dbe-b7dc-72dab2c29e27 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:47.992283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb696-2514-4dbe-b7dc-72dab2c29e27 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:47.992283 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb696-2514-4dbe-b7dc-72dab2c29e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:48.014132 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-878fb696-2514-4dbe-b7dc-72dab2c29e27 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:48.015350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-878fb696-2514-4dbe-b7dc-72dab2c29e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:48.023425 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 510/1011] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:48.486653 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a234b-cd6d-4fe8-ad5b-6d8a485f29fd None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:48.504141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a234b-cd6d-4fe8-ad5b-6d8a485f29fd None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:48.510945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:48.511474 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:48.511733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:48.512003 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:48.521460 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:48.523076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8023d98-e282-472b-a81e-ea2c5205e12a service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:48.533105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 502/1012] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:51.292372 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fb5b7-5b9e-4322-8694-44a554f89222 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:51.293016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fb5b7-5b9e-4322-8694-44a554f89222 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:51.293016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fb5b7-5b9e-4322-8694-44a554f89222 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:51.294396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 511/1013] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:51.299928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99655-8adf-4da6-b74a-9dbe8a2637e2 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:51.300361 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99655-8adf-4da6-b74a-9dbe8a2637e2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:51.300459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99655-8adf-4da6-b74a-9dbe8a2637e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:51.320498 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-79b99655-8adf-4da6-b74a-9dbe8a2637e2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:51.321710 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-79b99655-8adf-4da6-b74a-9dbe8a2637e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:51.330619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 503/1014] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:51.681328 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fb5b7-5b9e-4322-8694-44a554f89222 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:51.690547 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=46 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:51.697741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fb5b7-5b9e-4322-8694-44a554f89222 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:51.703116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:51.703711 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:51.703983 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:51.704249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:51.712748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:51.714665 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a258c-5995-4dc2-a8e7-693f88a3faff service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:51.724129 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 512/1015] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:51.966673 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402cd8-9329-464a-b1c7-291ad3c99038 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:51.966892 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402cd8-9329-464a-b1c7-291ad3c99038 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:51.967138 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402cd8-9329-464a-b1c7-291ad3c99038 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:51.968529 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 504/1016] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:51.974769 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7c3-884c-4a80-b843-665cb19af2e2 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:51.975193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7c3-884c-4a80-b843-665cb19af2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:51.975497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bc7c3-884c-4a80-b843-665cb19af2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:51.996700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-941bc7c3-884c-4a80-b843-665cb19af2e2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:51.998057 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-941bc7c3-884c-4a80-b843-665cb19af2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:52.006461 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 513/1017] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:52.364011 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a710e-2a3f-4a91-960f-a2b818c8e3ed None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:52.364569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a710e-2a3f-4a91-960f-a2b818c8e3ed None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:52.364569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a710e-2a3f-4a91-960f-a2b818c8e3ed None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:52.365898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 505/1018] 10.222.0.78 () {54 vars in 967 bytes} [Fri Aug 19 00:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:52.371321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b76-4ea1-46cc-aa23-6307d38018b6 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:52.371780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b76-4ea1-46cc-aa23-6307d38018b6 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:52.371880 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2b76-4ea1-46cc-aa23-6307d38018b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:52.420158 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-5f2a2b76-4ea1-46cc-aa23-6307d38018b6 None None] MFA Rules not processed for user `d6b9fb18e69b44d9a896adcf9533998e`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:52.421226 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5f2a2b76-4ea1-46cc-aa23-6307d38018b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:52.494792 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 514/1019] 10.222.0.78 () {58 vars in 1064 bytes} [Fri Aug 19 00:58:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:58:52.503648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a710e-2a3f-4a91-960f-a2b818c8e3ed None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:52.514957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a710e-2a3f-4a91-960f-a2b818c8e3ed None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:52.519080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6b9fb18e69b44d9a896adcf9533998e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:52.519661 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:52.519935 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:52.520199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:52.531083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:52.532549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621f4ad-d2ee-4ccf-ba60-f4ff7177a6c8 service glance] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:52.544004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 506/1020] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:53.935355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee6f-3d56-4f8d-a011-7bca68a6c4bf None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:53.936088 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee6f-3d56-4f8d-a011-7bca68a6c4bf None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:53.936088 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee6f-3d56-4f8d-a011-7bca68a6c4bf None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:53.937265 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 515/1021] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:53.942668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec60e2-d639-4e91-8dd2-eacfd994bef5 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:53.943216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec60e2-d639-4e91-8dd2-eacfd994bef5 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:53.943216 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec60e2-d639-4e91-8dd2-eacfd994bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:53.965440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-93ec60e2-d639-4e91-8dd2-eacfd994bef5 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:53.966625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-93ec60e2-d639-4e91-8dd2-eacfd994bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:53.974648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 507/1022] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:54.321277 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58ee6f-3d56-4f8d-a011-7bca68a6c4bf None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:54.335693 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58ee6f-3d56-4f8d-a011-7bca68a6c4bf None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:54.346124 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:54.346738 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:54.347019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:54.347285 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:54.358362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:54.360397 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac90a1-2f26-4b7c-a7e7-f7aba5e44f16 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:54.371867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 516/1023] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:58:56.689705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6bcf-6245-4a06-8b52-4f70183d1cf6 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:56.690744 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6bcf-6245-4a06-8b52-4f70183d1cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:56.691052 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6bcf-6245-4a06-8b52-4f70183d1cf6 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:56.698095 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 508/1024] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 00:58:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:58:56.703929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e05cf-7171-41b2-aa4b-5b21f97a0e3a None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:56.704446 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e05cf-7171-41b2-aa4b-5b21f97a0e3a None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:56.704446 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e05cf-7171-41b2-aa4b-5b21f97a0e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:56.729805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b04e05cf-7171-41b2-aa4b-5b21f97a0e3a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:58:56.731070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b04e05cf-7171-41b2-aa4b-5b21f97a0e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:58:56.739618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 517/1025] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 00:58:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:58:57.108823 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6bcf-6245-4a06-8b52-4f70183d1cf6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:58:57.117265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=92 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:58:57.128308 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6bcf-6245-4a06-8b52-4f70183d1cf6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:58:57.134173 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:58:57.134808 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:58:57.135224 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:58:57.135506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:58:57.144929 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:58:57.146542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dabc8-9a71-4227-b2b8-62b5de887873 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:58:57.156560 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 509/1026] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:58:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:06.722295 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=50 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:59:07.152148 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=5 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:59:08.049786 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070ce0-f2a0-46ba-95e3-88626eb3ceee None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:08.050483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070ce0-f2a0-46ba-95e3-88626eb3ceee None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:08.050483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070ce0-f2a0-46ba-95e3-88626eb3ceee None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:08.051715 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 518/1027] 10.222.0.78 () {54 vars in 918 bytes} [Fri Aug 19 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:08.057570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c29ae-c0ba-466c-a949-4b83fceacb2f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:08.057960 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c29ae-c0ba-466c-a949-4b83fceacb2f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:08.058729 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c29ae-c0ba-466c-a949-4b83fceacb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:08.089905 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-947c29ae-c0ba-466c-a949-4b83fceacb2f None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:08.096168 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-947c29ae-c0ba-466c-a949-4b83fceacb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:08.107264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 510/1028] 10.222.0.78 () {58 vars in 1015 bytes} [Fri Aug 19 00:59:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:08.125704 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e925aa7-109d-4842-a1c8-4603874671e4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:08.125991 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e925aa7-109d-4842-a1c8-4603874671e4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:08.126341 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e925aa7-109d-4842-a1c8-4603874671e4 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:08.127659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 519/1029] 10.222.0.78 () {54 vars in 918 bytes} [Fri Aug 19 00:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:08.132501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682ef9-ccb4-434b-89cb-c59400ffcdf8 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:08.132940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682ef9-ccb4-434b-89cb-c59400ffcdf8 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:08.133230 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682ef9-ccb4-434b-89cb-c59400ffcdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:08.154555 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-ea682ef9-ccb4-434b-89cb-c59400ffcdf8 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:08.155822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-ea682ef9-ccb4-434b-89cb-c59400ffcdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:08.165815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 511/1030] 10.222.0.78 () {58 vars in 1015 bytes} [Fri Aug 19 00:59:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:59:10.870104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e6c2-5d48-4f37-8977-90f8db287205 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:10.870624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e6c2-5d48-4f37-8977-90f8db287205 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:10.870624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e6c2-5d48-4f37-8977-90f8db287205 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:10.872001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 520/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:10.877453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ce6-51b7-4c65-85bc-393ad31167e8 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:10.877898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ce6-51b7-4c65-85bc-393ad31167e8 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:10.878004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ce6-51b7-4c65-85bc-393ad31167e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:10.898465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-c3d36ce6-51b7-4c65-85bc-393ad31167e8 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:10.899686 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-c3d36ce6-51b7-4c65-85bc-393ad31167e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:10.908583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 512/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:11.258632 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e6c2-5d48-4f37-8977-90f8db287205 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:11.274536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e6c2-5d48-4f37-8977-90f8db287205 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:11.280563 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:11.281188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:11.281472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:11.281743 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:11.290166 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:11.291884 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc3ddd-d4df-47ea-a308-1c612901f74b service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:11.301637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 521/1033] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:12.273313 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52402e3-20b6-4709-b544-5323f45950bd None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:12.273755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52402e3-20b6-4709-b544-5323f45950bd None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:12.273871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52402e3-20b6-4709-b544-5323f45950bd None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:12.275485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 513/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:12.280516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10638-ee2e-475c-883f-6e4ed0ca43db None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:12.280984 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10638-ee2e-475c-883f-6e4ed0ca43db None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:12.281089 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10638-ee2e-475c-883f-6e4ed0ca43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:12.300806 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-a0c10638-ee2e-475c-883f-6e4ed0ca43db None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:12.302031 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-a0c10638-ee2e-475c-883f-6e4ed0ca43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:12.310707 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 522/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:12.579453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52402e3-20b6-4709-b544-5323f45950bd None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:12.594458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52402e3-20b6-4709-b544-5323f45950bd None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:12.599955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:12.600545 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:12.600820 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:12.601134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:12.609880 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:12.611664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf06fc7-5f75-4310-82f7-8ac67bcbdaad service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:12.621420 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 514/1036] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:13.545000 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645bce0-cf92-4cf3-9e0a-1b4df58e9198 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:13.545546 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645bce0-cf92-4cf3-9e0a-1b4df58e9198 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:13.545546 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645bce0-cf92-4cf3-9e0a-1b4df58e9198 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:13.546918 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 523/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:13.552883 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47055b-8ae2-47cb-b3f8-d21e54d84a51 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:13.553393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47055b-8ae2-47cb-b3f8-d21e54d84a51 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:13.553486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47055b-8ae2-47cb-b3f8-d21e54d84a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:13.577158 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5a47055b-8ae2-47cb-b3f8-d21e54d84a51 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:13.578349 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5a47055b-8ae2-47cb-b3f8-d21e54d84a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:13.587476 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 515/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:13.745610 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645bce0-cf92-4cf3-9e0a-1b4df58e9198 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:13.767490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645bce0-cf92-4cf3-9e0a-1b4df58e9198 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:13.777811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:13.778643 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:13.778980 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:13.779293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:13.791522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:13.793167 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d434648-2903-4d46-9f7c-e3ea4abbff0d service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:13.804152 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 524/1039] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:14.687007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b03dd-5b4e-4493-8935-a2ee9df9adb6 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:14.687835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b03dd-5b4e-4493-8935-a2ee9df9adb6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:14.687835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b03dd-5b4e-4493-8935-a2ee9df9adb6 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:14.690074 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 516/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:14.695234 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11e08-e0b2-4725-a05c-1dcad8c9c3c7 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:14.695688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11e08-e0b2-4725-a05c-1dcad8c9c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:14.695791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f11e08-e0b2-4725-a05c-1dcad8c9c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:14.715663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-63f11e08-e0b2-4725-a05c-1dcad8c9c3c7 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:14.716849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-63f11e08-e0b2-4725-a05c-1dcad8c9c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:14.725526 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 525/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:14.881045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b03dd-5b4e-4493-8935-a2ee9df9adb6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:14.899189 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b03dd-5b4e-4493-8935-a2ee9df9adb6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:14.905877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:14.906475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:14.906751 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:14.907024 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:14.915097 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:14.917092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadc665-cde8-41bf-93d0-363d91682f3b service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:14.926105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 517/1042] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:15.810078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23d30-9d78-4393-87a7-803f5160a9df None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:15.810694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23d30-9d78-4393-87a7-803f5160a9df None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:15.810694 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23d30-9d78-4393-87a7-803f5160a9df None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:15.812726 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 526/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:15.821006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c525-9c1b-4dfb-9de7-bb9b0aeb6a80 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:15.821418 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c525-9c1b-4dfb-9de7-bb9b0aeb6a80 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:15.821620 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c525-9c1b-4dfb-9de7-bb9b0aeb6a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:15.850815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-6940c525-9c1b-4dfb-9de7-bb9b0aeb6a80 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:15.852045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-6940c525-9c1b-4dfb-9de7-bb9b0aeb6a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:15.863249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 518/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:16.018777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba23d30-9d78-4393-87a7-803f5160a9df None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:16.042198 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba23d30-9d78-4393-87a7-803f5160a9df None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:16.048724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:16.049355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:16.049635 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:16.049909 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:16.058819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:16.060488 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb6f2-8aa8-4336-99d7-6a2645a697b2 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:16.070204 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 527/1045] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:16.908171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9f4-4357-4fdd-a56c-d8c34e865e71 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:16.908992 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9f4-4357-4fdd-a56c-d8c34e865e71 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:16.909207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b9f4-4357-4fdd-a56c-d8c34e865e71 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:16.911292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 519/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:16.918607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878231-b59e-42be-9e61-0ec786ad4c28 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:16.919034 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878231-b59e-42be-9e61-0ec786ad4c28 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:16.919139 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878231-b59e-42be-9e61-0ec786ad4c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:16.941230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-d0878231-b59e-42be-9e61-0ec786ad4c28 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:16.942436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d0878231-b59e-42be-9e61-0ec786ad4c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:16.952004 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 528/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:17.110436 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43b9f4-4357-4fdd-a56c-d8c34e865e71 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:17.128778 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43b9f4-4357-4fdd-a56c-d8c34e865e71 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:17.134700 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:17.135129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:17.135719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:17.135719 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:17.145440 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:17.147946 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724c7b-8b27-4338-8000-f9eb3e774cd9 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:17.159677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 520/1048] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:17.982243 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab868be-9b4a-4f90-abe1-9833c99a8fdf None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:17.982863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab868be-9b4a-4f90-abe1-9833c99a8fdf None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:17.982863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab868be-9b4a-4f90-abe1-9833c99a8fdf None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:17.984122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 529/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:17.992579 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b908a-2cce-42fd-ad89-ee2603827d46 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:17.993291 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b908a-2cce-42fd-ad89-ee2603827d46 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:17.993515 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b908a-2cce-42fd-ad89-ee2603827d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:18.015314 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-970b908a-2cce-42fd-ad89-ee2603827d46 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:18.016486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-970b908a-2cce-42fd-ad89-ee2603827d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:18.025562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 521/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:18.181237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab868be-9b4a-4f90-abe1-9833c99a8fdf None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:18.197111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab868be-9b4a-4f90-abe1-9833c99a8fdf None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:18.203946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:18.204591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:18.204859 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:18.205159 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:18.213856 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:18.215432 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576d35e-26f7-4f88-a428-4d3b0c2b933f service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:18.224697 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 530/1051] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:19.057493 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263dd3-6f70-40ba-a75a-fb336586cf3a None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:19.058036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263dd3-6f70-40ba-a75a-fb336586cf3a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:19.058036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263dd3-6f70-40ba-a75a-fb336586cf3a None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:19.060557 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 522/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:19.068290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6640-83d6-4918-a1b3-6cdeee507cd0 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:19.069137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6640-83d6-4918-a1b3-6cdeee507cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:19.069316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd6640-83d6-4918-a1b3-6cdeee507cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:19.092264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-3ffd6640-83d6-4918-a1b3-6cdeee507cd0 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:19.093513 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3ffd6640-83d6-4918-a1b3-6cdeee507cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:19.102477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 531/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:19.259904 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0263dd3-6f70-40ba-a75a-fb336586cf3a None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:19.275754 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0263dd3-6f70-40ba-a75a-fb336586cf3a None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:19.281679 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:19.282279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:19.282517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:19.282822 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:19.291485 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:19.293100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f4070-1001-487a-9e9c-a45721553065 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:19.302513 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 523/1054] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:20.124505 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f97e4-46da-4bcc-b579-e6d6139de620 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:20.125122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f97e4-46da-4bcc-b579-e6d6139de620 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:20.125122 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f97e4-46da-4bcc-b579-e6d6139de620 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:20.126447 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 532/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 00:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:20.132639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8091-5aad-4054-a588-915d5fe58974 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:20.133111 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8091-5aad-4054-a588-915d5fe58974 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:20.133205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8091-5aad-4054-a588-915d5fe58974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:20.160008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0a2b8091-5aad-4054-a588-915d5fe58974 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:20.161163 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0a2b8091-5aad-4054-a588-915d5fe58974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:20.170034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 524/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 00:59:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:20.330382 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f97e4-46da-4bcc-b579-e6d6139de620 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:20.350499 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f97e4-46da-4bcc-b579-e6d6139de620 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:20.360471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:20.361489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:20.361900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:20.362348 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:20.374019 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:20.375696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0767230-6949-4aab-8998-2c36ec933462 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:20.387095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 533/1057] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:22.436699 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10098-4390-4c32-a35b-2f2b422c4e59 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:22.437323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10098-4390-4c32-a35b-2f2b422c4e59 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:22.437323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10098-4390-4c32-a35b-2f2b422c4e59 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:22.438635 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 525/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:22.445133 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d487d-26a0-40c3-97eb-4eb230f0e0ee None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:22.445849 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d487d-26a0-40c3-97eb-4eb230f0e0ee None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:22.445972 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d487d-26a0-40c3-97eb-4eb230f0e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:22.468737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ae6d487d-26a0-40c3-97eb-4eb230f0e0ee None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:22.469978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ae6d487d-26a0-40c3-97eb-4eb230f0e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:22.478551 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 534/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:22.823109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10098-4390-4c32-a35b-2f2b422c4e59 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:22.836096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10098-4390-4c32-a35b-2f2b422c4e59 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:22.840369 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:22.841013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:22.841292 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:22.841565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:22.850858 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:22.852341 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d5f2-84d8-4494-a73d-0d1612c06faf service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:22.862626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 526/1060] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:25.214527 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c212-9e1b-4572-8738-43952454ceba None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:25.215557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c212-9e1b-4572-8738-43952454ceba None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:25.215557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c212-9e1b-4572-8738-43952454ceba None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:25.217567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 535/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:25.226589 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130221e-485d-41b4-9a77-3e2fbcde8ccb None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:25.227310 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130221e-485d-41b4-9a77-3e2fbcde8ccb None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:25.227501 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130221e-485d-41b4-9a77-3e2fbcde8ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:25.251720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-1130221e-485d-41b4-9a77-3e2fbcde8ccb None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:25.252922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-1130221e-485d-41b4-9a77-3e2fbcde8ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:25.261731 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 527/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:59:25.599887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8c212-9e1b-4572-8738-43952454ceba None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:25.620467 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8c212-9e1b-4572-8738-43952454ceba None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:25.630548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:25.631239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:25.631481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:25.631801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:25.647291 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:25.649687 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fda5-737e-4842-a9d7-2d2eb55fcf7f service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:25.660016 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 536/1063] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:28.153294 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93eaf-4e17-4a80-9341-29cd2193454c None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:28.154136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93eaf-4e17-4a80-9341-29cd2193454c None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:28.154136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93eaf-4e17-4a80-9341-29cd2193454c None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:28.156238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 528/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:28.162559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563823e-2352-4a3b-95c0-237e0340eda4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:28.163145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563823e-2352-4a3b-95c0-237e0340eda4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:28.163294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563823e-2352-4a3b-95c0-237e0340eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:28.184568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1563823e-2352-4a3b-95c0-237e0340eda4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:28.185796 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1563823e-2352-4a3b-95c0-237e0340eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:28.193937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 537/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:28.530793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e93eaf-4e17-4a80-9341-29cd2193454c None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:28.543245 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e93eaf-4e17-4a80-9341-29cd2193454c None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:28.547662 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:28.548246 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:28.548520 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:28.548789 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:28.559177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:28.560615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d4df4-4095-42c3-b05d-d9a99f2ff2dd service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:28.569995 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 529/1066] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 00:59:31.092293 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8042c-cee3-434b-921e-7e74963d85b2 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:31.092848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8042c-cee3-434b-921e-7e74963d85b2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:31.092848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8042c-cee3-434b-921e-7e74963d85b2 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:31.094334 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 538/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:31.103373 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02d0f-0afa-4a60-9b3c-6ec4df544faa None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:31.103846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02d0f-0afa-4a60-9b3c-6ec4df544faa None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:31.104264 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02d0f-0afa-4a60-9b3c-6ec4df544faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:31.126957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-07f02d0f-0afa-4a60-9b3c-6ec4df544faa None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:31.128594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-07f02d0f-0afa-4a60-9b3c-6ec4df544faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:31.140298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 530/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:31.497234 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8042c-cee3-434b-921e-7e74963d85b2 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:31.515070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8042c-cee3-434b-921e-7e74963d85b2 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:31.521364 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:31.522189 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:31.522545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:31.522871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:31.533094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:31.534522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499821a5-a1ce-45ce-ae3b-9406ecfcd80c service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:31.543950 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 539/1069] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:33.807458 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a2ee-bb0b-4a6e-ac02-78b203d7521b None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:33.808331 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a2ee-bb0b-4a6e-ac02-78b203d7521b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:33.808331 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a2ee-bb0b-4a6e-ac02-78b203d7521b None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:33.810898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 531/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:33.817476 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10463f0-d255-41d4-9b22-f2369871518d None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:33.818142 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10463f0-d255-41d4-9b22-f2369871518d None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:33.818340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10463f0-d255-41d4-9b22-f2369871518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:33.841307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b10463f0-d255-41d4-9b22-f2369871518d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:33.842577 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b10463f0-d255-41d4-9b22-f2369871518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:33.850949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 540/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:34.201526 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a2ee-bb0b-4a6e-ac02-78b203d7521b None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:34.213366 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a2ee-bb0b-4a6e-ac02-78b203d7521b None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:34.217094 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:34.217681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:34.217955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:34.218218 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:34.226948 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:34.228500 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb8fee-9f44-41d5-b02c-c75ffbc6f663 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:34.238225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 532/1072] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 00:59:36.486624 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc9b6-0667-45c5-bf29-ac9b28b98209 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:36.487543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc9b6-0667-45c5-bf29-ac9b28b98209 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:36.487543 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc9b6-0667-45c5-bf29-ac9b28b98209 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:36.489855 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 541/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:36.496206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5ad-31b8-460d-be7e-141e3534332b None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:36.496961 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5ad-31b8-460d-be7e-141e3534332b None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:36.497120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab5ad-31b8-460d-be7e-141e3534332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:36.521730 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-236ab5ad-31b8-460d-be7e-141e3534332b None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:36.522933 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-236ab5ad-31b8-460d-be7e-141e3534332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:36.532005 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 533/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:36.881084 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc9b6-0667-45c5-bf29-ac9b28b98209 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:36.888006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=64 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:59:36.896618 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc9b6-0667-45c5-bf29-ac9b28b98209 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:36.901614 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:36.902214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:36.902489 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:36.902753 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:36.912256 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:36.913731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebc1a9-5a4a-46bb-912a-0a6c6a2f0414 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:36.923266 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 542/1075] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:39.217506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ec8e-3f1d-47f2-9c09-ee4a8e18e4d4 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:39.218371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ec8e-3f1d-47f2-9c09-ee4a8e18e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:39.218371 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ec8e-3f1d-47f2-9c09-ee4a8e18e4d4 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:39.220316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 534/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:39.228443 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbccf-deed-4482-a6f3-4d04889954cb None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:39.228885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbccf-deed-4482-a6f3-4d04889954cb None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:39.229022 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abbccf-deed-4482-a6f3-4d04889954cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:39.249264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-58abbccf-deed-4482-a6f3-4d04889954cb None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:39.250435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-58abbccf-deed-4482-a6f3-4d04889954cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:39.259471 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 543/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:39.603970 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ec8e-3f1d-47f2-9c09-ee4a8e18e4d4 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:39.613145 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=73 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:59:39.622021 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ec8e-3f1d-47f2-9c09-ee4a8e18e4d4 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:39.625590 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:39.626172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:39.626452 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:39.626724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:39.635816 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:39.637565 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50609-8edc-44fe-86a7-57c09a068734 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:39.646911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 535/1078] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:41.904777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371ae0-b3f2-4fc5-9e93-b4032ce29e8c None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:41.905690 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371ae0-b3f2-4fc5-9e93-b4032ce29e8c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:41.905690 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce371ae0-b3f2-4fc5-9e93-b4032ce29e8c None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:41.907794 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 544/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:41.913282 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577ec9-b3e0-4cfd-8c63-2386fa57b4e7 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:41.913715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577ec9-b3e0-4cfd-8c63-2386fa57b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:41.913815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc577ec9-b3e0-4cfd-8c63-2386fa57b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:41.935219 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-cc577ec9-b3e0-4cfd-8c63-2386fa57b4e7 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:41.936488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-cc577ec9-b3e0-4cfd-8c63-2386fa57b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:41.944777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 536/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:42.281773 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371ae0-b3f2-4fc5-9e93-b4032ce29e8c None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:42.293872 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce371ae0-b3f2-4fc5-9e93-b4032ce29e8c None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:42.298535 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:42.299139 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:42.299420 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:42.299670 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:42.309965 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:42.311386 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8583-60a0-4581-905a-ccf48994d15f service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:42.320712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 545/1081] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 00:59:44.541911 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead56d-6b0c-4213-9ae0-1f1a31f8d7be None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:44.542773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead56d-6b0c-4213-9ae0-1f1a31f8d7be None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:44.542773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead56d-6b0c-4213-9ae0-1f1a31f8d7be None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:44.544936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 537/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:44.551449 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dadc4-dcb1-4d3d-8af2-d57c67b74e14 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:44.552182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dadc4-dcb1-4d3d-8af2-d57c67b74e14 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:44.552362 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dadc4-dcb1-4d3d-8af2-d57c67b74e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:44.576472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-eb5dadc4-dcb1-4d3d-8af2-d57c67b74e14 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:44.577700 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-eb5dadc4-dcb1-4d3d-8af2-d57c67b74e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:44.586067 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 546/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 00:59:44.934175 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead56d-6b0c-4213-9ae0-1f1a31f8d7be None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:44.946554 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead56d-6b0c-4213-9ae0-1f1a31f8d7be None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:44.950998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:44.951583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:44.951859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:44.952129 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:44.961974 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:44.963504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6202df-c1dc-4379-80c7-1812c6fb0212 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:44.972920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 538/1084] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:47.221330 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c70-92bc-4f14-82fa-34b854f5c497 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:47.222188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c70-92bc-4f14-82fa-34b854f5c497 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:47.222188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66c70-92bc-4f14-82fa-34b854f5c497 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:47.224342 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 547/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 00:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 00:59:47.230953 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3781-7505-4af6-b938-605593159ee5 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:47.231672 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3781-7505-4af6-b938-605593159ee5 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:47.231788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3781-7505-4af6-b938-605593159ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:47.256954 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-163e3781-7505-4af6-b938-605593159ee5 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 00:59:47.258320 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-163e3781-7505-4af6-b938-605593159ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 00:59:47.272384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 539/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 00:59:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 00:59:47.628685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66c70-92bc-4f14-82fa-34b854f5c497 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 00:59:47.643125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66c70-92bc-4f14-82fa-34b854f5c497 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 00:59:47.647636 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 00:59:47.648244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 00:59:47.648524 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 00:59:47.648795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 00:59:47.658924 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 00:59:47.660376 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6f6f-be89-45e4-9b3a-531e02c942e7 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 00:59:47.670717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 548/1087] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 00:59:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 00:59:57.250894 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=17 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 00:59:57.665895 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=23 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:00:11.673838 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a7b5-478c-4816-be7e-efbb20c41310 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:11.674488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a7b5-478c-4816-be7e-efbb20c41310 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:11.674488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a7b5-478c-4816-be7e-efbb20c41310 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:11.675714 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 540/1088] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:11.681352 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bcd-f61b-48e3-bbd6-e7d220a67d33 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:11.681827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bcd-f61b-48e3-bbd6-e7d220a67d33 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:11.681937 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bcd-f61b-48e3-bbd6-e7d220a67d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:11.707572 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ed3a6bcd-f61b-48e3-bbd6-e7d220a67d33 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:11.708791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ed3a6bcd-f61b-48e3-bbd6-e7d220a67d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:11.718823 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 549/1089] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:12.089828 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7342-62b5-4ad7-8853-7e2dedec15fb None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:12.090137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7342-62b5-4ad7-8853-7e2dedec15fb None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:12.090413 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7342-62b5-4ad7-8853-7e2dedec15fb None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:12.091759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 541/1090] 10.222.0.78 () {54 vars in 967 bytes} [Fri Aug 19 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:12.097686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20bd0-ba70-47e6-9774-1f40acabe2ce None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:12.097997 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20bd0-ba70-47e6-9774-1f40acabe2ce None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:12.098266 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20bd0-ba70-47e6-9774-1f40acabe2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:12.119686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-b7d20bd0-ba70-47e6-9774-1f40acabe2ce None None] MFA Rules not processed for user `d6b9fb18e69b44d9a896adcf9533998e`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:12.120871 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-b7d20bd0-ba70-47e6-9774-1f40acabe2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:12.127697 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 550/1091] 10.222.0.78 () {58 vars in 1064 bytes} [Fri Aug 19 01:00:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:12.136081 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7342-62b5-4ad7-8853-7e2dedec15fb None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:12.152171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7342-62b5-4ad7-8853-7e2dedec15fb None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:12.157018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6b9fb18e69b44d9a896adcf9533998e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:12.157608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:12.157887 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:12.158162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:12.168295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:12.169767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c280a-53d4-4ebd-a1d9-83cd2792ff9d service glance] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:12.178969 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 542/1092] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:00:14.490995 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e1b2-65b1-4d0e-ac27-e90aa261020c None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:14.491616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e1b2-65b1-4d0e-ac27-e90aa261020c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:14.491616 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1e1b2-65b1-4d0e-ac27-e90aa261020c None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:14.493459 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 551/1093] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:14.501959 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dace4-03f3-4857-a046-f73a9de5186e None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:14.502391 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dace4-03f3-4857-a046-f73a9de5186e None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:14.502508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dace4-03f3-4857-a046-f73a9de5186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:14.524880 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5a6dace4-03f3-4857-a046-f73a9de5186e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:14.526144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5a6dace4-03f3-4857-a046-f73a9de5186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:14.535083 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 543/1094] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:14.870102 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e1b2-65b1-4d0e-ac27-e90aa261020c None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:14.888029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1e1b2-65b1-4d0e-ac27-e90aa261020c None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:14.894177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:14.895173 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:14.895626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:14.896064 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:14.897140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:14.899978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:00:14.899978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:00:14.899978 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:00:14.901148 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad2498-e062-4eb4-b382-af9dc790c09a admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:14.919673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 552/1095] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Aug 19 01:00:14 2022] GET /identity/v3/projects => generated 1606 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:00:17.087696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158c18-3d8b-448a-b9ab-01b93135fbda None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:17.088323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158c18-3d8b-448a-b9ab-01b93135fbda None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:17.088323 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158c18-3d8b-448a-b9ab-01b93135fbda None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:17.089610 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 544/1096] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:17.095177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558f08-ac12-4b76-9fd7-517a79ecf2f5 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:17.095609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558f08-ac12-4b76-9fd7-517a79ecf2f5 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:17.095720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558f08-ac12-4b76-9fd7-517a79ecf2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:17.121090 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-63558f08-ac12-4b76-9fd7-517a79ecf2f5 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:17.122307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-63558f08-ac12-4b76-9fd7-517a79ecf2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:17.131807 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 553/1097] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:00:17.482877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158c18-3d8b-448a-b9ab-01b93135fbda None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:17.503678 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158c18-3d8b-448a-b9ab-01b93135fbda None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:17.510395 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:17.511046 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:17.511648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:17.511928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:17.520613 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:17.522232 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce008-63fd-483a-98e6-215fc1afcdb5 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:17.532267 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 545/1098] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:00:19.920820 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b9df-a646-4b70-ae87-e1faa8cf1677 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:19.921695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b9df-a646-4b70-ae87-e1faa8cf1677 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:19.921695 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8b9df-a646-4b70-ae87-e1faa8cf1677 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:19.923911 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 554/1099] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:19.933100 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99551-b96b-422a-bf09-003b15a12ec6 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:19.933886 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99551-b96b-422a-bf09-003b15a12ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:19.934002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99551-b96b-422a-bf09-003b15a12ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:19.959874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-29b99551-b96b-422a-bf09-003b15a12ec6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:19.961116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-29b99551-b96b-422a-bf09-003b15a12ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:19.970615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 546/1100] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:20.320477 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8b9df-a646-4b70-ae87-e1faa8cf1677 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:20.338625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8b9df-a646-4b70-ae87-e1faa8cf1677 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:20.342708 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:20.343344 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:20.343619 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:20.343885 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:20.354505 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:20.355939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b7ac-c879-4ae8-80e3-a76a17fa1665 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:20.369153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 555/1101] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:00:22.555998 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742745-55f4-4b53-9b02-d1dd43c6c9d3 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:22.556578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742745-55f4-4b53-9b02-d1dd43c6c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:22.556578 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742745-55f4-4b53-9b02-d1dd43c6c9d3 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:22.557925 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 547/1102] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:22.564546 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0ca2-664b-44fd-8e25-1d9b0a4f50e2 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:22.565215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0ca2-664b-44fd-8e25-1d9b0a4f50e2 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:22.565378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0ca2-664b-44fd-8e25-1d9b0a4f50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:22.594353 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-41cf0ca2-664b-44fd-8e25-1d9b0a4f50e2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:22.595557 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-41cf0ca2-664b-44fd-8e25-1d9b0a4f50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:22.603603 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 556/1103] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:22.948833 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742745-55f4-4b53-9b02-d1dd43c6c9d3 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:22.968174 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742745-55f4-4b53-9b02-d1dd43c6c9d3 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:22.975153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:22.976074 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:22.976507 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:22.977109 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:22.986792 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:22.988218 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ce280-82b0-4292-abca-965b2f1b1474 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:22.998137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 548/1104] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:00:25.327359 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d648-2067-4ea2-83d1-94723c172b8f None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:25.328070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d648-2067-4ea2-83d1-94723c172b8f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:25.328070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d648-2067-4ea2-83d1-94723c172b8f None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:25.330322 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 557/1105] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:25.338679 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0551-ee8a-49d8-bfc2-250730982efa None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:25.339147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0551-ee8a-49d8-bfc2-250730982efa None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:25.339261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0551-ee8a-49d8-bfc2-250730982efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:25.359886 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-e78d0551-ee8a-49d8-bfc2-250730982efa None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:25.361106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e78d0551-ee8a-49d8-bfc2-250730982efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:25.371379 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 549/1106] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:25.721031 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23d648-2067-4ea2-83d1-94723c172b8f None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:25.733048 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23d648-2067-4ea2-83d1-94723c172b8f None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:25.736921 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:25.737515 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:25.737791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:25.738062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:25.747748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:25.749201 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdaf4f-d6fe-47b8-aff4-dd8f16be9caf service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:25.759735 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 558/1107] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:00:28.260539 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da3e0-22a1-486e-a7bd-0a6f7f3a0842 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:28.261029 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da3e0-22a1-486e-a7bd-0a6f7f3a0842 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:28.261127 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da3e0-22a1-486e-a7bd-0a6f7f3a0842 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:28.262439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 550/1108] 10.222.0.78 () {54 vars in 927 bytes} [Fri Aug 19 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:00:28.270877 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54fc1-808d-45f2-9407-033ebb873bc8 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:28.271295 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54fc1-808d-45f2-9407-033ebb873bc8 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:28.271497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54fc1-808d-45f2-9407-033ebb873bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:28.297914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-6be54fc1-808d-45f2-9407-033ebb873bc8 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:00:28.299126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-6be54fc1-808d-45f2-9407-033ebb873bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:00:28.307241 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 559/1109] 10.222.0.78 () {58 vars in 1024 bytes} [Fri Aug 19 01:00:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:00:28.652947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da3e0-22a1-486e-a7bd-0a6f7f3a0842 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:00:28.667365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da3e0-22a1-486e-a7bd-0a6f7f3a0842 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:00:28.673747 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:00:28.674639 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:00:28.675045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:00:28.675435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:00:28.686945 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:00:28.688401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794804d3-8586-40f0-9d7d-2b704e87fc5f service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:00:28.698363 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 551/1110] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:00:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:00:38.292919 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=33 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:00:38.693674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=33 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:01:42.776049 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:42.776709 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:42.776709 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:42.803058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:01:42.804490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:42.814272 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 560/1111] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:01:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:01:42.822697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:42.823214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:42.823319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:42.844712 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:01:42.845920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:42.855626 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 552/1112] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:01:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:01:42.860406 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:42.870976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad004cdc-13ad-4850-b114-717a09abc46e None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:42.877481 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:42.878083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:42.878356 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:42.878625 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:42.879267 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:01:42.879567 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:42.880568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:42.880568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:01:42.880568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:01:42.881976 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:42.895321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 561/1113] 10.222.0.78 () {58 vars in 1153 bytes} [Fri Aug 19 01:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:01:42.903842 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:42.914301 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930195-0382-42c3-8c25-a669f6aaa0a6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:42.920234 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:42.920830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:42.921141 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:42.921415 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:42.922026 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:42.923801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:42.923801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:01:42.923801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:01:42.925034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:42.955036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 553/1114] 10.222.0.78 () {60 vars in 1153 bytes} [Fri Aug 19 01:01:42 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:01:42.959926 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:42.969854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf930e-da94-4ffb-a24b-be3c9bad5b2a admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.031272 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.031963 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.032244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.032584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.033591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.034905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:43.034905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:01:43.034905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:01:43.036671 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.059509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 562/1115] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 01:01:42 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:01:43.063722 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.074575 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478be37-b39a-4b37-b075-66b67fa5dda9 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.079701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.080362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.080936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.081288 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.086966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.091649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:43.091649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:01:43.091649 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:01:43.092558 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.106901 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 554/1116] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:01:43.111070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.122001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56a06-9293-4681-a0d7-2caac800458d admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.126960 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.127560 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.127841 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.128111 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.128760 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.129818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:43.129818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:01:43.129818 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:01:43.130874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb26a-61ee-4e89-aee2-1fb9e83742dd admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.144844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 563/1117] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:01:43.149270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.159779 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706ee7-ebcf-49cd-8417-1dfed31da635 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.165302 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.165949 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.166225 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.166493 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] PATH_INFO: `/v3/projects/99e2ce7740fd4942a5405d0c9a6112e5/users/7e1af0e3c15147669cc1d7cd833ec3d1/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.181616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e2ce7740fd4942a5405d0c9a6112e5, user_id=7e1af0e3c15147669cc1d7cd833ec3d1, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.182633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:43.182633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:01:43.182633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:01:43.184861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b73270-e967-41fb-87cf-e806c3515fe7 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.203703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 555/1118] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:01:43 2022] PUT /identity/v3/projects/99e2ce7740fd4942a5405d0c9a6112e5/users/7e1af0e3c15147669cc1d7cd833ec3d1/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:01:43.221698 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcbcb2-4cac-4051-ba5c-b980423ed6c1 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.221986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcbcb2-4cac-4051-ba5c-b980423ed6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.222262 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcbcb2-4cac-4051-ba5c-b980423ed6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.251287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1ffcbcb2-4cac-4051-ba5c-b980423ed6c1 None None] MFA Rules not processed for user `7e1af0e3c15147669cc1d7cd833ec3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:01:43.252503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1ffcbcb2-4cac-4051-ba5c-b980423ed6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:43.319269 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 564/1119] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:01:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:01:43.336496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fa63-3ec9-43dc-a049-3a2c08a284b3 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.336786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fa63-3ec9-43dc-a049-3a2c08a284b3 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.337103 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3fa63-3ec9-43dc-a049-3a2c08a284b3 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.338456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 556/1120] 10.222.0.78 () {54 vars in 964 bytes} [Fri Aug 19 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:01:43.343396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7f38-4fcd-4d29-92f3-1510b23f435b None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.343713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7f38-4fcd-4d29-92f3-1510b23f435b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.343990 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7f38-4fcd-4d29-92f3-1510b23f435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.363691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-e42a7f38-4fcd-4d29-92f3-1510b23f435b None None] MFA Rules not processed for user `a4e4a153fdc34de3ae75b098acbb165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:01:43.364878 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-e42a7f38-4fcd-4d29-92f3-1510b23f435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:43.411713 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:01:43.421310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 565/1121] 10.222.0.78 () {58 vars in 1061 bytes} [Fri Aug 19 01:01:43 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:01:43.431577 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3fa63-3ec9-43dc-a049-3a2c08a284b3 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.443971 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3fa63-3ec9-43dc-a049-3a2c08a284b3 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.448096 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.448690 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.448997 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.449298 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.458078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.459564 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.468455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 557/1122] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:01:43 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:01:43.507188 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396106c0-58a1-48d3-9dd7-4198f4a23b7f None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.507497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396106c0-58a1-48d3-9dd7-4198f4a23b7f None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.507778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396106c0-58a1-48d3-9dd7-4198f4a23b7f None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.509083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 566/1123] 10.222.0.78 () {52 vars in 830 bytes} [Fri Aug 19 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:01:43.512997 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.579231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6247f09-22d6-4ddc-9e7d-414aacda1e8b service cinder] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.585157 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.585777 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.586054 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.586327 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] PATH_INFO: `/v3/users/7e1af0e3c15147669cc1d7cd833ec3d1` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.587580 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1af0e3c15147669cc1d7cd833ec3d1)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.588615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:43.588615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:01:43.588615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:01:43.589871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.659231 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1af0e3c15147669cc1d7cd833ec3d1'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:43.683789 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1af0e3c15147669cc1d7cd833ec3d1'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:43.698392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1af0e3c15147669cc1d7cd833ec3d1'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:43.699347 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1af0e3c15147669cc1d7cd833ec3d1'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:43.710931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1af0e3c15147669cc1d7cd833ec3d1'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:43.717601 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 558/1124] 10.222.0.78 () {58 vars in 1224 bytes} [Fri Aug 19 01:01:43 2022] DELETE /identity/v3/users/7e1af0e3c15147669cc1d7cd833ec3d1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:01:43.722144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.722430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.722705 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.746244 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:01:43.747842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:43.821183 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 567/1125] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:01:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:01:43.831007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:43.832428 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:43.839008 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:01:43.899853 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5c8c-cace-44e8-8713-484590e936de admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:43.906317 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:43.907197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:43.907701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:43.908147 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:43.924036 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:43.926263 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe23f6-d2cc-4e77-ae8e-66795d2450d1 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:43.941489 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 559/1126] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:01:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:01:44.321672 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:01:44.323165 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:01:44.335909 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a437-153f-4e3c-b103-57ea7f27a988 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:01:44.341270 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:01:44.341858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:01:44.342136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:01:44.342405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] PATH_INFO: `/v3/projects/99e2ce7740fd4942a5405d0c9a6112e5` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:01:44.343568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e2ce7740fd4942a5405d0c9a6112e5)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:01:44.344663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:01:44.344663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:01:44.344663 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:01:44.345876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:01:44.412932 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e2ce7740fd4942a5405d0c9a6112e5', 'request_id': 'req-8a88d486-d14a-41f7-a90f-e33e007623e3'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:44.419558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e2ce7740fd4942a5405d0c9a6112e5', 'request_id': 'req-8a88d486-d14a-41f7-a90f-e33e007623e3'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:44.435195 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e2ce7740fd4942a5405d0c9a6112e5', 'request_id': 'req-8a88d486-d14a-41f7-a90f-e33e007623e3'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:44.451647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] The token cache is being invalidate because project 99e2ce7740fd4942a5405d0c9a6112e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:01:44.451940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:44.452603 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-8a88d486-d14a-41f7-a90f-e33e007623e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:01:44.454215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 568/1127] 10.222.0.78 () {58 vars in 1233 bytes} [Fri Aug 19 01:01:44 2022] DELETE /identity/v3/projects/99e2ce7740fd4942a5405d0c9a6112e5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:01:53.934392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=25 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:01:54.448673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:03:02.592563 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:02.593206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:02.593206 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:02.595457 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 560/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:02.601121 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04906-4c17-4b0a-940b-e135709a63ca None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:02.601595 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04906-4c17-4b0a-940b-e135709a63ca None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:02.601699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04906-4c17-4b0a-940b-e135709a63ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:02.675320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-dbb04906-4c17-4b0a-940b-e135709a63ca None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:02.676548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-dbb04906-4c17-4b0a-940b-e135709a63ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:02.781164 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 569/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:03:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:02.943692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:02.946887 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:03.047146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c7a2-84f9-4965-b7bf-5427cc0bbbba None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:03.052994 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:03.053594 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:03.053867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:03.054137 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:03.062956 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:03.064542 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb445a4-49f8-4f82-92a9-2628a78b6bf7 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:03.074050 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 561/1130] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:03.923558 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039658-2aa4-48f5-a0a5-96bccde1b387 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:03.924294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039658-2aa4-48f5-a0a5-96bccde1b387 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:03.924294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039658-2aa4-48f5-a0a5-96bccde1b387 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:03.925688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 570/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:03.930936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629647f-e575-4318-a5ce-b251f977674d None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:03.931657 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629647f-e575-4318-a5ce-b251f977674d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:03.931843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629647f-e575-4318-a5ce-b251f977674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:03.953867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5629647f-e575-4318-a5ce-b251f977674d None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:03.955063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5629647f-e575-4318-a5ce-b251f977674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:03.963503 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 562/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:03:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:04.125497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039658-2aa4-48f5-a0a5-96bccde1b387 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:04.140757 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039658-2aa4-48f5-a0a5-96bccde1b387 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:04.147146 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:04.147751 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:04.148032 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:04.148300 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:04.156688 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:04.158307 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21641ec7-e215-4042-a64b-1da26b339b33 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:04.168673 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 571/1133] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:08.521066 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9533-a664-440a-97f6-9d930628c638 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:08.521688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9533-a664-440a-97f6-9d930628c638 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:08.521688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9533-a664-440a-97f6-9d930628c638 None None] PATH_INFO: `/v3` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:08.522947 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 563/1134] 10.222.0.42 () {54 vars in 925 bytes} [Fri Aug 19 01:03:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:03:08.529463 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b5ef-7b61-4e34-a0eb-c941709823b9 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:08.529914 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b5ef-7b61-4e34-a0eb-c941709823b9 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:08.530037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b5ef-7b61-4e34-a0eb-c941709823b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:08.559892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1f46b5ef-7b61-4e34-a0eb-c941709823b9 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:08.561115 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1f46b5ef-7b61-4e34-a0eb-c941709823b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:08.618450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:03:08.630608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 572/1135] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 19 01:03:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:12.794689 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580eb4-8b94-4bdf-abf7-b736d4386223 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:12.795566 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580eb4-8b94-4bdf-abf7-b736d4386223 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:12.795566 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc580eb4-8b94-4bdf-abf7-b736d4386223 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:12.797803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 564/1136] 10.222.0.78 () {54 vars in 961 bytes} [Fri Aug 19 01:03:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:12.803678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10660-f90f-495d-83c5-2ae79bfac489 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:12.804172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10660-f90f-495d-83c5-2ae79bfac489 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:12.804172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f10660-f90f-495d-83c5-2ae79bfac489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:12.832766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-86f10660-f90f-495d-83c5-2ae79bfac489 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:12.834033 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-86f10660-f90f-495d-83c5-2ae79bfac489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:12.846185 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 573/1137] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Aug 19 01:03:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:12.919965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc580eb4-8b94-4bdf-abf7-b736d4386223 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:12.936568 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc580eb4-8b94-4bdf-abf7-b736d4386223 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:12.942451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:12.943045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:12.943325 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:12.943587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:12.952171 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:12.953809 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef220c-ffa4-43bf-8e13-1e85a10000c3 service placement] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:12.963827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 565/1138] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:15.467940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c75-7339-436b-8772-e8b32441a640 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:15.468573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c75-7339-436b-8772-e8b32441a640 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:15.468573 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c75-7339-436b-8772-e8b32441a640 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:15.469865 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:15.475922 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e27f-071a-4278-959c-65dc22b46200 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:15.476655 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e27f-071a-4278-959c-65dc22b46200 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:15.476870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66e27f-071a-4278-959c-65dc22b46200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:15.508259 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-9c66e27f-071a-4278-959c-65dc22b46200 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:15.509801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-9c66e27f-071a-4278-959c-65dc22b46200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:15.519863 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:03:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:15.678399 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557c75-7339-436b-8772-e8b32441a640 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:15.693450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557c75-7339-436b-8772-e8b32441a640 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:15.698819 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:15.699438 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:15.699717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:15.699986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:15.709472 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:15.711483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adc17e-29e3-4807-b059-a2fa810209e8 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:15.722093 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 575/1141] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:16.579134 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec974-8ed4-4c7c-94a8-36814430c40f None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:16.580101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec974-8ed4-4c7c-94a8-36814430c40f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:16.580101 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec974-8ed4-4c7c-94a8-36814430c40f None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:16.581469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 567/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:16.589678 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cc2f-490e-48eb-bc2c-b83adf63e352 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:16.590387 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cc2f-490e-48eb-bc2c-b83adf63e352 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:16.590559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cc2f-490e-48eb-bc2c-b83adf63e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:16.618787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-3f55cc2f-490e-48eb-bc2c-b83adf63e352 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:16.620009 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-3f55cc2f-490e-48eb-bc2c-b83adf63e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:16.629840 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 576/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:03:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:16.796002 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ec974-8ed4-4c7c-94a8-36814430c40f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:16.818605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ec974-8ed4-4c7c-94a8-36814430c40f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:16.824562 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:16.825179 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:16.825455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:16.825728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:16.834193 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:16.835703 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dc9cf-88c8-4b68-aec1-653e159e7444 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:16.846126 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 568/1144] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:20.981806 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:20.982706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:20.982706 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:20.984944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:20.991146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09721-496c-4ab3-9347-b3ed8b2bd3b2 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:20.991570 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09721-496c-4ab3-9347-b3ed8b2bd3b2 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:20.991720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09721-496c-4ab3-9347-b3ed8b2bd3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:21.011940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-98f09721-496c-4ab3-9347-b3ed8b2bd3b2 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:21.013253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-98f09721-496c-4ab3-9347-b3ed8b2bd3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:21.021583 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:03:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:21.391116 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:21.394905 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:21.462359 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb89c4-fe5a-4102-99b7-19476ca25008 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:21.467423 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:21.468065 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:21.468347 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:21.468615 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:21.479522 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:21.480996 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf73d10-f44b-42f6-880b-08ca497ad632 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:21.490580 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 578/1147] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:23.648931 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c764cf-b256-479c-9759-13a13004aad9 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:23.649492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c764cf-b256-479c-9759-13a13004aad9 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:23.649492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c764cf-b256-479c-9759-13a13004aad9 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:23.650790 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 570/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:23.657134 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaa96e-8360-4a3d-a533-a79a452884f4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:23.657839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaa96e-8360-4a3d-a533-a79a452884f4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:23.658119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaa96e-8360-4a3d-a533-a79a452884f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:23.680559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-2bcaa96e-8360-4a3d-a533-a79a452884f4 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:23.682106 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-2bcaa96e-8360-4a3d-a533-a79a452884f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:23.691169 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 579/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:03:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:24.045200 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c764cf-b256-479c-9759-13a13004aad9 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:24.052451 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=61 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:03:24.059573 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c764cf-b256-479c-9759-13a13004aad9 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:24.064132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:24.064725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:24.065033 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:24.065325 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:24.074270 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:24.076087 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3ffb2-c999-4848-9ad5-40866d968123 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:24.085728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 571/1150] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:27.808228 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:27.808777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:27.808777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:27.810196 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 580/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:27.817042 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af07dc-abde-4475-b6a1-9ca0a29e621a None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:27.817742 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af07dc-abde-4475-b6a1-9ca0a29e621a None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:27.817937 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af07dc-abde-4475-b6a1-9ca0a29e621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:27.843041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-31af07dc-abde-4475-b6a1-9ca0a29e621a None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:27.844237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-31af07dc-abde-4475-b6a1-9ca0a29e621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:27.853696 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 572/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:03:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:28.424483 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:28.426349 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:28.489109 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7c906-edf7-42c4-86a5-288effd67458 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:28.493075 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:28.493680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:28.493953 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:28.494221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:28.504058 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:28.505532 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed5722-e105-4011-8f67-091ef73f2eec service cinder] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:28.514852 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 581/1153] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:30.757988 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:30.758943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:30.758943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:30.761078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 573/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:03:30.767209 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2356-7038-4842-8bbb-a06b2283100e None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:30.767677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2356-7038-4842-8bbb-a06b2283100e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:30.767781 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2356-7038-4842-8bbb-a06b2283100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:30.788965 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-bc0b2356-7038-4842-8bbb-a06b2283100e None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:03:30.790202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-bc0b2356-7038-4842-8bbb-a06b2283100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:30.799373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 582/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:03:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:03:31.383510 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:03:31.386841 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:03:31.403615 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee774-8be1-49e0-a8b1-04e6d6cb8b7f None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:03:31.407487 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:03:31.408106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:03:31.408392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:03:31.408667 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:03:31.417646 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:03:31.419055 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1a9ba-c683-4b13-a434-5d72ceca52a8 service cinder] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:03:31.428633 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 574/1156] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:03:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:03:40.783072 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=70 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:03:41.424957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=14 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:04:45.453324 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.453944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.453944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.475486 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:45.476779 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:45.486294 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 583/1157] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:04:45.494800 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.495329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.495329 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.515990 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:45.517238 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:45.526877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 575/1158] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:04:45.531895 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.541783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e3d15-0c7f-4a79-9597-b54156e02aae None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.546591 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.547194 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.547475 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.547749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] PATH_INFO: `/v3/domains` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.548413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:04:45.548716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.550542 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.563528 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 584/1159] 10.222.0.78 () {58 vars in 1153 bytes} [Fri Aug 19 01:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:04:45.579376 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.589084 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fb717-f317-46a7-8cd2-9c770cf63b05 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.594940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.595541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.595815 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.596155 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.596773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.598786 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0200f5-a86f-4529-8460-e2a4d120d32c admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.646166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 576/1160] 10.222.0.78 () {60 vars in 1153 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:04:45.650545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.653613 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e2c1-6aac-4572-b994-2e9120aa488f None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.654380 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e2c1-6aac-4572-b994-2e9120aa488f None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.654380 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e2c1-6aac-4572-b994-2e9120aa488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.662839 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1cc2-71d5-468e-a0db-2a9bc1633996 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.674877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-2087e2c1-6aac-4572-b994-2e9120aa488f None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:45.676117 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-2087e2c1-6aac-4572-b994-2e9120aa488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:45.720114 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.720637 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.720946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.721222 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.721842 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.723764 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.737105 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 577/1161] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:04:45.750343 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 585/1162] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:04:45.750720 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.751006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.751277 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.754816 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.767239 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40dd3-7ea7-484f-9716-88c96c8dc21c admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.773302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.773965 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.774257 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.774565 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.775260 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.775431 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:45.776518 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:45.777037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.785531 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 578/1163] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:04:45.795563 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 586/1164] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:04:45.795759 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.796717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.806899 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e66f1-7cda-468b-8ab5-65249e22e749 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.811647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d09ae-ae87-4175-8285-ce31608fe786 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.813619 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.814392 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.814797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.815176 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] PATH_INFO: `/v3/domains` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.816032 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:04:45.816540 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.818051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:04:45.818051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:04:45.818051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:04:45.819488 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.819949 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.821051 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.821507 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.821787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.822850 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.825003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.837772 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 587/1165] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:04:45.842092 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 579/1166] 10.222.0.78 () {58 vars in 1153 bytes} [Fri Aug 19 01:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:04:45.844335 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.854007 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.854231 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1bdb9-12d2-4a31-9919-1cd37bcb3f6c admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.859027 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.859656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.859954 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.860211 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] PATH_INFO: `/v3/projects/362a015c6be746e68d065f495e77e001/users/f6e26118a42a4d4bbfac599cd31935ed/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.865334 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eba24-017a-4f9f-ab90-2b8159de313f admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:45.870587 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:45.871180 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.871456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.871724 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.872375 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.875453 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.879024 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362a015c6be746e68d065f495e77e001, user_id=f6e26118a42a4d4bbfac599cd31935ed, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:45.880095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:04:45.880095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:04:45.880095 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:04:45.882221 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d81cc9-e0b2-438c-8816-976858604c09 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:45.899151 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 588/1167] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:45 2022] PUT /identity/v3/projects/362a015c6be746e68d065f495e77e001/users/f6e26118a42a4d4bbfac599cd31935ed/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:04:45.906509 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418bdc-0703-425f-8903-64b100adb772 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:45.906846 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418bdc-0703-425f-8903-64b100adb772 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:45.907171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80418bdc-0703-425f-8903-64b100adb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:45.911464 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 580/1168] 10.222.0.78 () {60 vars in 1153 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:04:45.915478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:45.932063 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-80418bdc-0703-425f-8903-64b100adb772 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:45.933424 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-80418bdc-0703-425f-8903-64b100adb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:46.007435 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 589/1169] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:04:46.014943 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ca8a9-9691-4270-8125-45744875369c admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.017748 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80418bdc-0703-425f-8903-64b100adb772 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:46.020725 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.021397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.021641 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.021900 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.022556 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.023525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:04:46.023525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:04:46.023525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:04:46.024755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.053251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:04:46.059116 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 581/1170] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 01:04:45 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:04:46.060970 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:46.076816 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e757a-a6f2-4f94-8f22-91d2618d838c admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.083705 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.084592 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.085073 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.085504 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.086525 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.089199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.097035 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:04:46.097289 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80418bdc-0703-425f-8903-64b100adb772 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.101622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.102274 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.102551 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.102827 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.110677 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 582/1171] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:04:46.111738 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:46.117428 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.119078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.121469 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598095c-13a7-4fa8-ba96-2027096f3962 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.126625 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.127234 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.127551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.127797 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.128486 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.130272 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ea4a5-1c71-4351-937a-4c1c6ef4019b admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.133490 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 590/1172] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:04:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:04:46.142258 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 583/1173] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:04:46.147190 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:46.163368 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec7dd-e218-46e7-8ffa-fb1aa2b84486 service neutron] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.170944 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.171946 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.172395 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.172874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] PATH_INFO: `/v3/projects/c1b225eb7c7e4d5faf7c9aa8130549a8/users/a05d99faf85b4abeb64eb9de0600ceb4/roles/a8b781dc46fb43c9aaaac21dba171b3c` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.196299 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b225eb7c7e4d5faf7c9aa8130549a8, user_id=a05d99faf85b4abeb64eb9de0600ceb4, role_id=a8b781dc46fb43c9aaaac21dba171b3c)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.199014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.237990 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 591/1174] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:46 2022] PUT /identity/v3/projects/c1b225eb7c7e4d5faf7c9aa8130549a8/users/a05d99faf85b4abeb64eb9de0600ceb4/roles/a8b781dc46fb43c9aaaac21dba171b3c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:04:46.243596 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954777ff-89c2-48e8-9eb3-65343a707399 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.243890 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954777ff-89c2-48e8-9eb3-65343a707399 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.244164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954777ff-89c2-48e8-9eb3-65343a707399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.267644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-954777ff-89c2-48e8-9eb3-65343a707399 None None] MFA Rules not processed for user `9fd2a745f79241bebdcc3d551a59c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:46.269045 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-954777ff-89c2-48e8-9eb3-65343a707399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:46.346664 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 584/1175] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:04:46.359811 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:46.361770 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:46.474897 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa192d-63df-4153-90f3-4fc595eaddfd admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:46.481844 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:46.483369 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:46.483876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:46.484432 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:46.502860 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:46.504689 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:46.518854 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 592/1176] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:04:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:04:51.731611 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:51.732242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:51.732928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:51.832757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] MFA Rules not processed for user `f6e26118a42a4d4bbfac599cd31935ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:51.834708 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:51.974475 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 585/1177] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:51 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:04:51.980104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:51.994613 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a865d-2b41-4f7e-ad75-4e85b66af048 service neutron] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.003596 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.004608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.005108 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.005564 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] PATH_INFO: `/v3/projects` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.006628 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.008350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:04:52.008350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:04:52.008350 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:04:52.022144 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.084218 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 593/1178] 10.222.0.78 () {60 vars in 1153 bytes} [Fri Aug 19 01:04:51 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:04:52.088283 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:52.108977 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac99df-f253-48e3-ab78-4b2bab098b95 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.201955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.202939 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.203370 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.203788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] PATH_INFO: `/v3/users` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.204644 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.207319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.239340 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 586/1179] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 01:04:52 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:04:52.243710 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:52.263617 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c68c9-3716-4ced-855b-732966625054 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.270370 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.271492 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.272412 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.273119 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.274028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.276060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.300038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:52.300622 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 594/1180] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:04:52.318515 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cef4-2be5-4e99-813c-8143dba342b5 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.328041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.329760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.330190 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.330648 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] PATH_INFO: `/v3/projects/ab3a7fba710547659b2471a988a8f743/users/37fc779c775e4c56948e3e73e3d96b68/roles/b63e277927a74d40a291769119d60894` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.336080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:04:52.366152 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a7fba710547659b2471a988a8f743, user_id=37fc779c775e4c56948e3e73e3d96b68, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.377166 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.407632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 587/1181] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:52 2022] PUT /identity/v3/projects/ab3a7fba710547659b2471a988a8f743/users/37fc779c775e4c56948e3e73e3d96b68/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:04:52.411699 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:52.428173 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82cb86-f655-4aec-9ddd-53b1570b4792 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.511094 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.511910 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.512749 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.512927 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] PATH_INFO: `/v3/roles` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.514950 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.517197 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7196678-3db5-418e-a528-64fa6fd43129 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.520327 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:04:52.542014 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 595/1182] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:04:52.542622 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:52.555616 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b06558-4d6b-4b5b-8a7e-e4bd311cc91e admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:52.561368 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:52.562056 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] REQUEST_METHOD: `PUT` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:52.562335 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:52.563272 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] PATH_INFO: `/v3/projects/ab3a7fba710547659b2471a988a8f743/users/37fc779c775e4c56948e3e73e3d96b68/roles/b63e277927a74d40a291769119d60894` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:52.565409 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a7fba710547659b2471a988a8f743, user_id=37fc779c775e4c56948e3e73e3d96b68, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:52.568755 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:52.588728 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 588/1183] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:52 2022] PUT /identity/v3/projects/ab3a7fba710547659b2471a988a8f743/users/37fc779c775e4c56948e3e73e3d96b68/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:04:53.024686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.026258 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.026984 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.074602 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:04:53.077193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:04:53.179933 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 596/1184] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:04:53 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:04:53.180671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.282839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c388f-4b3d-412f-b666-2a683f170123 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.288533 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.289521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.290727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.291126 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] PATH_INFO: `/v3/projects` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.291794 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.294492 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.341803 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 589/1185] 10.222.0.78 () {60 vars in 1153 bytes} [Fri Aug 19 01:04:53 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:04:53.347060 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.364682 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9092b-a277-4960-822f-a29381c7fed4 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.458310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.458556 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.458737 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.459177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] PATH_INFO: `/v3/users` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.459892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.462181 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.493847 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 597/1186] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Aug 19 01:04:53 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:04:53.499336 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.517838 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a716f1-c0e9-45b0-acbe-e9e80b98f26d admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.527207 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.528397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.528397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.528726 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.529658 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.531606 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.559401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 590/1187] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:04:53.565537 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.582451 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491632-6e62-446a-8a74-43861f03bfba admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.593556 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.594260 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.594791 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.595069 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] PATH_INFO: `/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b/users/f262faf0da0b45449c1e54a7e8975c4f/roles/b63e277927a74d40a291769119d60894` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.615216 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=131caad0d2e64c1eb9ab4b778df7f28b, user_id=f262faf0da0b45449c1e54a7e8975c4f, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.618153 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.636125 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 598/1188] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:53 2022] PUT /identity/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b/users/f262faf0da0b45449c1e54a7e8975c4f/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:04:53.641248 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.652859 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af1a5d-184e-4709-882e-1495d3584862 admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.742470 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.743199 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.743571 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.743839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.744435 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.747385 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ff713-6824-4761-9c1d-9a7b5d2f74f3 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.801144 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 591/1189] 10.222.0.78 () {58 vars in 1122 bytes} [Fri Aug 19 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:04:53.807430 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:04:53.822211 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fed639-c41f-41c9-b945-4c2f1826d4bf admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:04:53.836948 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:04:53.838041 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] REQUEST_METHOD: `PUT` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:04:53.839062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:04:53.841755 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] PATH_INFO: `/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b/users/f262faf0da0b45449c1e54a7e8975c4f/roles/b63e277927a74d40a291769119d60894` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:04:53.849650 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=131caad0d2e64c1eb9ab4b778df7f28b, user_id=f262faf0da0b45449c1e54a7e8975c4f, role_id=b63e277927a74d40a291769119d60894)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:04:53.852136 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:04:53.869886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 599/1190] 10.222.0.78 () {60 vars in 1483 bytes} [Fri Aug 19 01:04:53 2022] PUT /identity/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b/users/f262faf0da0b45449c1e54a7e8975c4f/roles/b63e277927a74d40a291769119d60894 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:05:00.377185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc254-0e36-40ba-bf12-83ac50aa4a60 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:00.380722 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc254-0e36-40ba-bf12-83ac50aa4a60 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:00.381185 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc254-0e36-40ba-bf12-83ac50aa4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:00.446483 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-376bc254-0e36-40ba-bf12-83ac50aa4a60 None None] MFA Rules not processed for user `37fc779c775e4c56948e3e73e3d96b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:00.448530 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-376bc254-0e36-40ba-bf12-83ac50aa4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:00.483018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:00.534652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 592/1191] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:05:00 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:00.549776 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:00.552357 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:00.619406 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:00.648542 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc3ce-ae6c-4cfc-9ef3-3356c659d33a admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:00.661214 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6b9fb18e69b44d9a896adcf9533998e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:00.661858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:00.662140 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:00.662741 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:00.729555 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:00.729787 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:00.742493 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 600/1192] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:00 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:01.247401 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdee1-775c-4b41-8b2b-77492aa33061 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:01.247773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdee1-775c-4b41-8b2b-77492aa33061 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:01.248004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fdee1-775c-4b41-8b2b-77492aa33061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:01.292508 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-ef8fdee1-775c-4b41-8b2b-77492aa33061 None None] MFA Rules not processed for user `f262faf0da0b45449c1e54a7e8975c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:01.293941 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-ef8fdee1-775c-4b41-8b2b-77492aa33061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:01.390063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 593/1193] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:05:01 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:01.404834 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:01.415373 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2020d-accb-4688-ad6e-cbfd158b8079 service glance] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:01.422568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6b9fb18e69b44d9a896adcf9533998e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:01.423402 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:01.423973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:01.426548 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:01.504757 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:01.506498 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851cb33-8e92-4236-816f-1b1f8ec1644a service glance] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:01.519986 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 601/1194] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:01 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:09.863177 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3798-e7ae-41ce-9fe8-6a424738ad58 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:09.864715 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3798-e7ae-41ce-9fe8-6a424738ad58 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:09.865312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3798-e7ae-41ce-9fe8-6a424738ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:09.886757 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-0d6a3798-e7ae-41ce-9fe8-6a424738ad58 None None] MFA Rules not processed for user `f6e26118a42a4d4bbfac599cd31935ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:09.888059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-0d6a3798-e7ae-41ce-9fe8-6a424738ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:09.896966 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 594/1195] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:05:09 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:10.196310 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c948a7-90bf-42fc-9f56-99b6b035990d None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:10.196860 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c948a7-90bf-42fc-9f56-99b6b035990d None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:10.196860 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c948a7-90bf-42fc-9f56-99b6b035990d None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:10.198215 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 602/1196] 10.222.0.78 () {54 vars in 962 bytes} [Fri Aug 19 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:05:10.203976 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f07d-c6ff-474e-a6ef-baf24f277e28 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:10.204608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f07d-c6ff-474e-a6ef-baf24f277e28 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:10.204608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7f07d-c6ff-474e-a6ef-baf24f277e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:10.240748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-2ca7f07d-c6ff-474e-a6ef-baf24f277e28 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:10.245632 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-2ca7f07d-c6ff-474e-a6ef-baf24f277e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:10.327132 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 595/1197] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Aug 19 01:05:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:10.334562 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:10.334973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:10.335378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:10.337487 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 603/1198] 10.222.0.78 () {54 vars in 912 bytes} [Fri Aug 19 01:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:05:10.345748 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4816c-ab6a-4c9b-9949-3d81b6d6e293 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:10.346120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4816c-ab6a-4c9b-9949-3d81b6d6e293 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:10.346462 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4816c-ab6a-4c9b-9949-3d81b6d6e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:10.372756 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-5cf4816c-ab6a-4c9b-9949-3d81b6d6e293 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:10.374004 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-5cf4816c-ab6a-4c9b-9949-3d81b6d6e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:10.384110 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 596/1199] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Aug 19 01:05:10 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:10.398001 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:10.400171 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:10.416017 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183469f-ea7a-42ee-91c9-4eab51989ef4 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:10.421392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6b9fb18e69b44d9a896adcf9533998e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:10.422439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:10.422932 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:10.423413 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:10.438861 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:10.440942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70f36f-af55-414a-91e6-b29465bdb8ab service glance] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:10.454264 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 604/1200] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:05:11.035512 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3ede-3986-4a86-986e-ed8edc86008d None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.036452 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3ede-3986-4a86-986e-ed8edc86008d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.036452 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a3ede-3986-4a86-986e-ed8edc86008d None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.037445 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 597/1201] 10.222.0.78 () {54 vars in 912 bytes} [Fri Aug 19 01:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:11.043355 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026947-986b-44af-9f73-59b400d27d95 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.043686 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026947-986b-44af-9f73-59b400d27d95 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.043989 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c026947-986b-44af-9f73-59b400d27d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.076716 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-8c026947-986b-44af-9f73-59b400d27d95 None None] MFA Rules not processed for user `dd7abf396926447ea82b5c2215e9124f`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:11.078498 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-8c026947-986b-44af-9f73-59b400d27d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:11.156812 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 605/1202] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Aug 19 01:05:11 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:11.170569 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a3ede-3986-4a86-986e-ed8edc86008d None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:11.186711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a3ede-3986-4a86-986e-ed8edc86008d None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:11.193770 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:11.193770 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.194192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.194321 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.204788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:11.207249 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb819b-f62f-4e76-a662-bc067bb2f9fe service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:11.221336 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 598/1203] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:11.697043 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f02b-17af-4ec8-b67d-e4a067acf41d None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.697648 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f02b-17af-4ec8-b67d-e4a067acf41d None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.697777 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f02b-17af-4ec8-b67d-e4a067acf41d None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.700083 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 606/1204] 10.222.0.78 () {54 vars in 962 bytes} [Fri Aug 19 01:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:11.706839 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ea3b-17b4-499a-ac40-2c088ac972fb None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.707133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ea3b-17b4-499a-ac40-2c088ac972fb None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.707445 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ea3b-17b4-499a-ac40-2c088ac972fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.727251 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb219-cdba-4793-8f4d-526d6f9968be None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.728062 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb219-cdba-4793-8f4d-526d6f9968be None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.728923 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb219-cdba-4793-8f4d-526d6f9968be None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.729681 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-e3e9ea3b-17b4-499a-ac40-2c088ac972fb None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:11.731332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e3e9ea3b-17b4-499a-ac40-2c088ac972fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:11.731833 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 607/1205] 10.222.0.78 () {54 vars in 961 bytes} [Fri Aug 19 01:05:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:11.741829 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.742157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.742396 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.745886 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 599/1206] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Aug 19 01:05:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:11.751996 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ccc8-10bf-4d94-8549-ba2d0eb66a26 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.752307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ccc8-10bf-4d94-8549-ba2d0eb66a26 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.752647 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ccc8-10bf-4d94-8549-ba2d0eb66a26 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.754496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 600/1207] 10.222.0.78 () {54 vars in 912 bytes} [Fri Aug 19 01:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:05:11.763204 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.765162 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.766016 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.776613 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=100 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:11.779874 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:11.781680 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:11.797652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:11.799354 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:11.800044 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=100 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:11.814543 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 601/1208] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Aug 19 01:05:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:05:11.831860 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:11.849337 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a7cb8-9130-40d3-bc49-6b5a20232b50 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:11.854861 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:11.855585 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.855864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.856136 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.868733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:11.870915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f09671-9612-47e4-aec8-a540431a3c5d service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:11.879794 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 608/1209] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Aug 19 01:05:11 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:05:11.884091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 602/1210] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:05:11.896598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:11.908203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204949-b22c-4c54-9d37-9cd114469df0 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:11.914053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:11.914754 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:11.915039 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:11.915503 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:11.918196 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:11.931006 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:11.933387 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:11.961410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 609/1211] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:11 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:21.429588 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba969e-5c3c-4efa-9460-808d9c9de13d None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:21.430153 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba969e-5c3c-4efa-9460-808d9c9de13d None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:21.430333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba969e-5c3c-4efa-9460-808d9c9de13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:21.451188 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-4bba969e-5c3c-4efa-9460-808d9c9de13d None None] MFA Rules not processed for user `dd7abf396926447ea82b5c2215e9124f`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:21.452387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-4bba969e-5c3c-4efa-9460-808d9c9de13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:21.460028 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 603/1212] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 19 01:05:21 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:21.473029 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:21.482684 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b695c1-5b9a-4b7e-8bb2-1f8531cf0593 service placement] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:21.486550 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:21.487154 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:21.487436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:21.487720 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:21.495308 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:21.496780 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044db3cd-7525-46ae-937d-fb4ad5bdc704 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:21.505878 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 610/1213] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:21 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:05:22.383455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592d80-e040-4fcf-bd36-4a8be9dd80e6 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:22.383455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592d80-e040-4fcf-bd36-4a8be9dd80e6 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:22.383455 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592d80-e040-4fcf-bd36-4a8be9dd80e6 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:22.384957 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 604/1214] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 01:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:22.452366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f317-c08e-4dbd-817a-cd52f2d81363 None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:22.452366 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f317-c08e-4dbd-817a-cd52f2d81363 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:22.452679 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f317-c08e-4dbd-817a-cd52f2d81363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:22.473429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-1bb8f317-c08e-4dbd-817a-cd52f2d81363 None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:22.474797 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-1bb8f317-c08e-4dbd-817a-cd52f2d81363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:22.489846 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 611/1215] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 01:05:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:22.542609 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592d80-e040-4fcf-bd36-4a8be9dd80e6 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:22.558299 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592d80-e040-4fcf-bd36-4a8be9dd80e6 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:22.564830 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:22.565457 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:22.565727 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:22.566076 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:22.576088 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:22.577736 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d099-d936-4f0a-bb4f-56a554541000 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:22.603034 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 605/1216] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:28.742290 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff05a-450e-428e-bebc-1c1644f2be23 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:28.742888 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff05a-450e-428e-bebc-1c1644f2be23 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:28.742888 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ff05a-450e-428e-bebc-1c1644f2be23 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:28.744186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 612/1217] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 01:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:28.758078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:28.758650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:28.758650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:28.786659 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:28.789305 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:28.800603 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 606/1218] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 01:05:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:28.818531 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ff05a-450e-428e-bebc-1c1644f2be23 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:28.838909 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ff05a-450e-428e-bebc-1c1644f2be23 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:28.844320 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:28.845046 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:28.845511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:28.845785 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:28.857141 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:28.861900 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b81aa2-5f30-4a21-8115-dae588cdf33b service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:28.873516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 613/1219] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:38.779541 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=19 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:38.869066 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=42 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:40.855576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:40.865521 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4825fe-acf0-4bf7-bb22-7407a739c1bb None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:40.869030 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:40.869788 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:40.870091 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:40.870332 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:40.880059 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:40.881548 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56d8ec-33fe-4437-b6cf-e866ac1e18de service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:40.890989 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 607/1220] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:40 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:43.037367 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173ffd1-a62f-4c74-916f-7d730e2c9050 None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:43.038478 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173ffd1-a62f-4c74-916f-7d730e2c9050 None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:43.039137 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173ffd1-a62f-4c74-916f-7d730e2c9050 None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:43.041392 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 614/1221] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 01:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:05:43.046605 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd7d4-ed39-441d-9541-e8addfd8cdca None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:43.047518 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd7d4-ed39-441d-9541-e8addfd8cdca None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:43.048006 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd7d4-ed39-441d-9541-e8addfd8cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:43.076514 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-70bcd7d4-ed39-441d-9541-e8addfd8cdca None None] MFA Rules not processed for user `1a6424b0415b4383b7593ae57032d520`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:05:43.078442 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-70bcd7d4-ed39-441d-9541-e8addfd8cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:05:43.092165 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 608/1222] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 01:05:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:05:43.107783 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173ffd1-a62f-4c74-916f-7d730e2c9050 None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:05:43.125436 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173ffd1-a62f-4c74-916f-7d730e2c9050 None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:05:43.130757 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:05:43.132609 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:05:43.132886 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:05:43.133249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:05:43.142388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:05:43.144302 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e228f-4828-4675-a2ad-63aa0d4baae2 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:05:43.155733 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 615/1223] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:05:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:05:53.068765 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=9 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:05:53.152185 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=6 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:06:02.649767 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef4ea-8466-44fb-bac1-1d6d44b42300 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:06:02.650356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef4ea-8466-44fb-bac1-1d6d44b42300 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:06:02.650356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef4ea-8466-44fb-bac1-1d6d44b42300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:06:02.670882 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fcfef4ea-8466-44fb-bac1-1d6d44b42300 None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:06:02.672078 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fcfef4ea-8466-44fb-bac1-1d6d44b42300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:06:02.679928 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 609/1224] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:06:02 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:06:12.664496 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:06:29.256795 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:06:29.257545 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:06:29.257656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:06:29.277597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:06:29.278794 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:06:29.286078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 616/1225] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:06:29 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:06:29.605311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63cb9-24bc-40dc-8eb6-f1e4bbb27c20 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:06:29.605812 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63cb9-24bc-40dc-8eb6-f1e4bbb27c20 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:06:29.605898 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63cb9-24bc-40dc-8eb6-f1e4bbb27c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:06:29.632459 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-abd63cb9-24bc-40dc-8eb6-f1e4bbb27c20 None None] MFA Rules not processed for user `dd7abf396926447ea82b5c2215e9124f`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:06:29.633773 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-abd63cb9-24bc-40dc-8eb6-f1e4bbb27c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:06:29.641674 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 610/1226] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Aug 19 01:06:29 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:06:29.656311 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:06:29.672110 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ddad1-b853-4e6d-bf97-c7bf2d57e95e None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:06:29.680018 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:06:29.680724 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:06:29.681127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:06:29.681405 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:06:29.689568 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:06:29.691071 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955dccc-7bff-4146-833b-66d2631d963e service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:06:29.699647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 617/1227] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:06:29 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:06:39.626242 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:06:39.695831 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=9 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:06:42.979279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:06:42.980015 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:06:42.980187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:06:43.004704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:06:43.006133 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:06:43.014333 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 611/1228] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:06:42 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:06:52.999187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:07:39.684939 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:07:39.685445 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:07:39.685536 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:07:39.705388 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:07:39.706691 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:07:39.714981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 618/1229] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:07:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:07:49.700427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=3 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:07:51.569973 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:07:51.588630 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376ad84-b8f0-4b7f-b586-ccbd558aa705 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:07:51.592254 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:07:51.592871 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:07:51.593194 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:07:51.593478 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:07:51.602965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:07:51.604399 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fc7b8-0bb2-4618-a6f3-10f3b110a5c6 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:07:51.614176 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 612/1230] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:07:51 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:08:01.609843 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=10 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:08:13.748868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:08:13.761982 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6a370-2584-40dc-86fb-46eb18f1996c None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:08:13.768633 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:08:13.769316 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:08:13.769597 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:08:13.769873 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:08:13.779227 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:08:13.780848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:08:13.792516 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 619/1231] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:08:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:08:23.786805 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=6 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:32.351716 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede52bb-b2de-436b-ae33-167fd22bcea1 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:32.352253 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede52bb-b2de-436b-ae33-167fd22bcea1 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:32.352348 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede52bb-b2de-436b-ae33-167fd22bcea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:32.373468 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-1ede52bb-b2de-436b-ae33-167fd22bcea1 None None] MFA Rules not processed for user `f6e26118a42a4d4bbfac599cd31935ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:09:32.374870 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-1ede52bb-b2de-436b-ae33-167fd22bcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:09:32.382940 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 613/1232] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:09:32 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:09:42.367138 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=3 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:06.454801 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:06.477414 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fd4a0-92ef-40c5-b316-364982b3d587 service placement] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:06.483028 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:06.483647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:06.483929 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:06.484206 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:06.493876 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:06.495667 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:06.506608 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 620/1233] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:06 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:10.199479 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:10.200187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:10.200187 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:10.226352 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:10.227551 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:10.242950 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 614/1234] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:10:10 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:10:10.288582 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:10.371127 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0af7d-4320-4e56-ba58-4e3045ac3bde service nova] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:10.375096 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:10.375712 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:10.375992 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:10.376281 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:10.387177 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:10.388634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:10.400281 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 621/1235] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:10.974316 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:10.984295 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8332c2-94b4-482e-b369-dd49eef657cc None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:10.988227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:10.988835 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:10.989145 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:10.989394 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:10.997213 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:10.998651 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:11.006936 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 615/1236] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:13.634491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:13.645253 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbad7-bc7b-43bc-aecc-d6852698ff7f service cinder] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:13.650268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:13.651070 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:13.651360 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:13.651634 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:13.664498 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:13.666099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:13.677562 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 622/1237] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:21.003343 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=9 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.672603 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=46 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:24.652149 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:24.664312 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa73e6-2883-45a0-9d23-a0ff7e5b30e3 service neutron] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:24.670818 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:24.671465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:24.671746 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:24.672038 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:24.680108 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:24.681869 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:24.692048 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 616/1238] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:24 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:24.975721 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:24.986906 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cbe1-da37-4e6c-a935-6e651eb0a251 service neutron] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:24.991858 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:24.992604 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:24.993196 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:24.993575 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.003647 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:25.005145 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:25.013892 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 623/1239] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:24 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:25.740517 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:25.751319 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeaa88-a7c3-442a-a1ed-d1095353310d service nova] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:25.756701 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:25.757356 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.757650 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.757888 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.767120 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:25.768697 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:25.779599 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 617/1240] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:10:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:10:35.010427 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=6 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:35.775067 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=12 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.908940 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.924747 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8410b7-fd7f-48bf-914a-f290692f2b7b service neutron] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.931863 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.932643 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.933203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.933692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.947583 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.950439 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed6b9d-8c8b-436b-81b4-3060030bda76 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.965623 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 624/1241] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:11:27.907198 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.918558 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22789f-f94b-4b75-9a75-4964f5b93739 service nova] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.922854 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.923511 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.923793 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.924063 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.987846 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.989804 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78499d-b5ec-4b94-8d4d-6f2a9a3aed14 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:28.009367 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 618/1242] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:11:29.959099 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=6 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.690867 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59d53-c7db-4162-949b-ed9c483c3c9b None None] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.691484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59d53-c7db-4162-949b-ed9c483c3c9b None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.691484 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59d53-c7db-4162-949b-ed9c483c3c9b None None] PATH_INFO: `/` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.693756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 625/1243] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 01:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:31.718408 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc448dd-63f2-45a5-9dff-165d58df8da3 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.718893 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc448dd-63f2-45a5-9dff-165d58df8da3 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.719080 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc448dd-63f2-45a5-9dff-165d58df8da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.804205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-bbc448dd-63f2-45a5-9dff-165d58df8da3 None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:31.805463 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-bbc448dd-63f2-45a5-9dff-165d58df8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:31.825311 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 619/1244] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 01:11:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:11:31.836627 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59d53-c7db-4162-949b-ed9c483c3c9b None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.851584 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59d53-c7db-4162-949b-ed9c483c3c9b None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.856731 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.857410 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.857683 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.857951 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.866607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.868245 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c5f9-1368-4ce4-b322-4f34d29ef37e service placement] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.878311 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 626/1245] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:11:35.295780 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5f48-bcad-4060-b221-85db20690fb5 None None] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.296365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5f48-bcad-4060-b221-85db20690fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.296365 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5f48-bcad-4060-b221-85db20690fb5 None None] PATH_INFO: `/` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.297864 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 620/1246] 10.222.0.78 () {54 vars in 921 bytes} [Fri Aug 19 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:35.306645 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] REQUEST_METHOD: `POST` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.308371 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.309172 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.341278 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.auth.core [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] MFA Rules not processed for user `a6465174c65748dcbefbf791e42c8e22`. Rule list: `[]` (Enabled: `True`). {{(pid=88439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:35.342761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:35.352704 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad5f48-bcad-4060-b221-85db20690fb5 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.358461 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 627/1247] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Aug 19 01:11:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:11:35.375156 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.382212 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad5f48-bcad-4060-b221-85db20690fb5 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.388552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efea07-a7f1-468e-90b2-d7a3de8069ec None None] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.389184 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.390733 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.391247 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.391668 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] PATH_INFO: `/v3/users/f6e26118a42a4d4bbfac599cd31935ed` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.393608 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e26118a42a4d4bbfac599cd31935ed)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.396442 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.396801 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.397985 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.398408 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.399081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.422005 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.423887 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.438322 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 628/1248] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:11:35.455915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e26118a42a4d4bbfac599cd31935ed'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.471269 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e26118a42a4d4bbfac599cd31935ed'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.479862 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e26118a42a4d4bbfac599cd31935ed'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.480652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e26118a42a4d4bbfac599cd31935ed'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.490307 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e26118a42a4d4bbfac599cd31935ed'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.498296 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 621/1249] 10.222.0.78 () {58 vars in 1224 bytes} [Fri Aug 19 01:11:35 2022] DELETE /identity/v3/users/f6e26118a42a4d4bbfac599cd31935ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:35.698182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.714598 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe3fa9-3ad5-48bf-94d1-876a578d3d0d service placement] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.786059 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.787073 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.787415 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.787677 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] PATH_INFO: `/v3/projects/362a015c6be746e68d065f495e77e001` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.789429 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362a015c6be746e68d065f495e77e001)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.791834 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.842511 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362a015c6be746e68d065f495e77e001', 'request_id': 'req-c1d4c01a-8c68-4862-b8b8-e36d4443da32'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.847778 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362a015c6be746e68d065f495e77e001', 'request_id': 'req-c1d4c01a-8c68-4862-b8b8-e36d4443da32'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.853981 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362a015c6be746e68d065f495e77e001', 'request_id': 'req-c1d4c01a-8c68-4862-b8b8-e36d4443da32'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.867942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] The token cache is being invalidate because project 362a015c6be746e68d065f495e77e001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:11:35.868285 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.868977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:35.870639 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 629/1250] 10.222.0.78 () {58 vars in 1233 bytes} [Fri Aug 19 01:11:35 2022] DELETE /identity/v3/projects/362a015c6be746e68d065f495e77e001 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:11:35.874874 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.876537 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:35.890894 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c816c9-2174-4213-9e1a-13aa0e847ddb admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.895915 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:35.955088 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.955867 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.956146 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.956456 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] PATH_INFO: `/v3/users/37fc779c775e4c56948e3e73e3d96b68` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.957692 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fc779c775e4c56948e3e73e3d96b68)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.960159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.011481 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fc779c775e4c56948e3e73e3d96b68'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.023909 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fc779c775e4c56948e3e73e3d96b68'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.031279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fc779c775e4c56948e3e73e3d96b68'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.032041 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fc779c775e4c56948e3e73e3d96b68'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.043176 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-c09acea6-2544-4f37-9b91-b991d97d0f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fc779c775e4c56948e3e73e3d96b68'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.049749 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 622/1251] 10.222.0.78 () {58 vars in 1224 bytes} [Fri Aug 19 01:11:35 2022] DELETE /identity/v3/users/37fc779c775e4c56948e3e73e3d96b68 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:36.237450 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.238971 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:36.255384 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c01a-8c68-4862-b8b8-e36d4443da32 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.308607 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.315692 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.316815 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.317261 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.317636 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] PATH_INFO: `/v3/projects/ab3a7fba710547659b2471a988a8f743` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.318868 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3a7fba710547659b2471a988a8f743)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.321287 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.370398 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3a7fba710547659b2471a988a8f743', 'request_id': 'req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.375977 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3a7fba710547659b2471a988a8f743', 'request_id': 'req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.383660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3a7fba710547659b2471a988a8f743', 'request_id': 'req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.399203 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] The token cache is being invalidate because project ab3a7fba710547659b2471a988a8f743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:11:36.399491 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.400157 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:11:36.401696 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 630/1252] 10.222.0.78 () {58 vars in 1233 bytes} [Fri Aug 19 01:11:36 2022] DELETE /identity/v3/projects/ab3a7fba710547659b2471a988a8f743 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:46.046172 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.395003 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:16.954877 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] REQUEST_METHOD: `POST` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:16.955465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:16.955465 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:16.976827 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.auth.core [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] MFA Rules not processed for user `a05d99faf85b4abeb64eb9de0600ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:16.978123 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:17.042549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 623/1253] 10.222.0.78 () {58 vars in 958 bytes} [Fri Aug 19 01:12:16 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:12:17.449015 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:17.451271 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:17.538193 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563cdb-fe81-44a9-9ccc-0c226bc5a34d admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:17.542963 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:17.543761 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:17.544036 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:17.544319 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:17.547497 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:17.562721 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:17.564756 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:17.576076 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 631/1254] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:12:17 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:12:18.237745 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:18.239291 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:18.316707 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544cf5-b123-46f3-9e16-278fff424185 None None] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:18.321505 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:18.322112 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:18.322387 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:18.322652 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:18.324309 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:18.335279 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:18.336856 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:18.346480 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 624/1255] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:12:18 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:12:26.774969 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:26.776460 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:26.851446 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437630b1-c978-4520-b605-d05e13ba24b2 service neutron] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:26.857186 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6424b0415b4383b7593ae57032d520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:26.857804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:26.858081 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:26.858340 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:26.860742 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:26.872728 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:26.874378 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:26.884100 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 632/1256] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:12:26 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:12:28.342660 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=57 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:36.880167 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=58 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:19.706018 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:19.708157 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:19.779378 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf299-c1e7-4974-867d-ee6f21636a46 service placement] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:19.785618 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:19.786237 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:19.786821 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:19.787124 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:19.789130 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:19.801760 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:19.803384 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:19.813576 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 625/1257] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:13:19 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:13:29.809678 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=28 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:15:06.529053 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:06.530559 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:06.636660 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86522f5d-a8ac-4d6f-b46a-bdf3c5efd941 service nova] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:06.643240 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e4a153fdc34de3ae75b098acbb165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:06.643845 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:06.644120 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:06.644428 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:06.646446 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:06.680496 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:06.681975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:06.701315 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 633/1258] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:15:06 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:15:06.964197 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:06.965670 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:06.989847 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed9b47-c039-4dc8-b705-5cbe9f9a8228 service placement] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:06.993362 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7abf396926447ea82b5c2215e9124f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:06.993965 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] REQUEST_METHOD: `GET` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:06.994271 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:06.994549 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:06.996304 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:07.083792 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:07.085164 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:07.095106 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 626/1259] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:15:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:15:13.591191 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:13.592685 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:13.615973 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2fc0-fb4b-45b5-907b-3cc3bceaafa9 service cinder] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:13.620581 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:13.621223 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:13.621525 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:13.621804 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] PATH_INFO: `/v3/users/a05d99faf85b4abeb64eb9de0600ceb4` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:13.622942 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05d99faf85b4abeb64eb9de0600ceb4)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:13.623975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: WARNING py.warnings [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:15:13.623975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: warnings.warn(msg) Aug 19 01:15:13.623975 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: Aug 19 01:15:13.625249 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:13.692202 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05d99faf85b4abeb64eb9de0600ceb4'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:13.700184 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05d99faf85b4abeb64eb9de0600ceb4'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:13.720684 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05d99faf85b4abeb64eb9de0600ceb4'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:13.732123 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05d99faf85b4abeb64eb9de0600ceb4'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:13.732923 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05d99faf85b4abeb64eb9de0600ceb4'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:13.739790 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 634/1260] 10.222.0.78 () {58 vars in 1224 bytes} [Fri Aug 19 01:15:13 2022] DELETE /identity/v3/users/a05d99faf85b4abeb64eb9de0600ceb4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:15:13.921688 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:13.932495 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249520-28b3-4ba7-89f4-23adf0143361 service neutron] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:13.994107 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:13.994737 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:13.995013 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:13.995284 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] PATH_INFO: `/v3/projects/c1b225eb7c7e4d5faf7c9aa8130549a8` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:13.996397 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b225eb7c7e4d5faf7c9aa8130549a8)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:13.997454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: WARNING py.warnings [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:15:13.997454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: warnings.warn(msg) Aug 19 01:15:13.997454 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: Aug 19 01:15:13.998671 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:14.066336 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b225eb7c7e4d5faf7c9aa8130549a8', 'request_id': 'req-66df8e9c-723c-4522-ab60-56f14c62e91f'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.074506 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b225eb7c7e4d5faf7c9aa8130549a8', 'request_id': 'req-66df8e9c-723c-4522-ab60-56f14c62e91f'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.087958 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b225eb7c7e4d5faf7c9aa8130549a8', 'request_id': 'req-66df8e9c-723c-4522-ab60-56f14c62e91f'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.092261 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:15:14.100920 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] The token cache is being invalidate because project c1b225eb7c7e4d5faf7c9aa8130549a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:15:14.101214 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.102241 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.104075 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 627/1261] 10.222.0.78 () {58 vars in 1233 bytes} [Fri Aug 19 01:15:13 2022] DELETE /identity/v3/projects/c1b225eb7c7e4d5faf7c9aa8130549a8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:15:14.108321 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:14.109891 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:14.123343 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149f3d9-5f8e-4049-8578-1b2f3c63404e admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:14.127230 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:15:14.182626 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:14.183268 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:14.183552 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:14.183825 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] PATH_INFO: `/v3/users/f262faf0da0b45449c1e54a7e8975c4f` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:14.196746 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f262faf0da0b45449c1e54a7e8975c4f)` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:14.199037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:14.249966 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f262faf0da0b45449c1e54a7e8975c4f'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.259656 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f262faf0da0b45449c1e54a7e8975c4f'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.274659 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f262faf0da0b45449c1e54a7e8975c4f'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.281432 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f262faf0da0b45449c1e54a7e8975c4f'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.282078 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.notifications [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f262faf0da0b45449c1e54a7e8975c4f'} {{(pid=88439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.288431 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 635/1262] 10.222.0.78 () {58 vars in 1224 bytes} [Fri Aug 19 01:15:14 2022] DELETE /identity/v3/users/f262faf0da0b45449c1e54a7e8975c4f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:15:14.477192 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Authenticating user token {{(pid=88438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:15:14.479227 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.fernet_utils [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:15:14.493567 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df8e9c-723c-4522-ab60-56f14c62e91f admin admin] Validating token access rules against request {{(pid=88438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:15:14.554553 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fd2a745f79241bebdcc3d551a59c8f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '560e1cc0afb64bafa1e6557ba86b9432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:15:14.555159 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:15:14.555439 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:15:14.555711 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] PATH_INFO: `/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b` {{(pid=88438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:15:14.566393 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=131caad0d2e64c1eb9ab4b778df7f28b)` {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:15:14.568325 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] RBAC: Authorization granted {{(pid=88438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:15:14.615265 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131caad0d2e64c1eb9ab4b778df7f28b', 'request_id': 'req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.624093 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131caad0d2e64c1eb9ab4b778df7f28b', 'request_id': 'req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.631051 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131caad0d2e64c1eb9ab4b778df7f28b', 'request_id': 'req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc'} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.642205 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] The token cache is being invalidate because project 131caad0d2e64c1eb9ab4b778df7f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:15:14.642721 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.643484 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG keystone.notifications [None req-5682dd47-7071-4a94-8527-b5d8f1d2e6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:15:14.645168 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: [pid: 88438|app: 0|req: 628/1263] 10.222.0.78 () {58 vars in 1233 bytes} [Fri Aug 19 01:15:14 2022] DELETE /identity/v3/projects/131caad0d2e64c1eb9ab4b778df7f28b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:15:24.285338 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:15:24.638955 dv-osbrick-853710-1-ceph devstack@keystone.service[88438]: DEBUG dbcounter [-] [88438] Writing DB stats keystone:DELETE=8,keystone:SELECT=57,keystone:INSERT=1 {{(pid=88438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:18:22.646037 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Authenticating user token {{(pid=88439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:18:22.647718 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:18:22.727736 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4b3de-4860-4966-a55f-c85a1a422556 admin admin] Validating token access rules against request {{(pid=88439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:18:22.799237 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6465174c65748dcbefbf791e42c8e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edb418136fcb4bcb843d91af3ad17b37', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:18:22.799848 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] REQUEST_METHOD: `GET` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:18:22.800126 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] SCRIPT_NAME: `/identity` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:18:22.800398 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:18:22.802182 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.fernet_utils [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:18:22.814104 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:18:22.815717 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29f2bf-ebb7-456c-ba91-202122f10b33 service placement] RBAC: Authorization granted {{(pid=88439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:18:22.826011 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: [pid: 88439|app: 0|req: 636/1264] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Aug 19 01:18:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:18:32.822766 dv-osbrick-853710-1-ceph devstack@keystone.service[88439]: DEBUG dbcounter [-] [88439] Writing DB stats keystone:SELECT=58 {{(pid=88439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}